-- Logs begin at Fri 2021-11-12 01:46:12 UTC, end at Fri 2021-11-12 02:53:49 UTC. -- Nov 12 02:17:36.079691 dv-cinder-808574-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 12 02:17:36.088717 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Nov 12 02:17:36 2021] *** Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: nodename: dv-cinder-808574-4-iscsi Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: machine: x86_64 Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: clock source: unix Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: pcre jit disabled Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: detected number of CPU cores: 4 Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: current working directory: / Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: detected binary path: /usr/bin/uwsgi-core Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: your processes number limit is 47680 Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: your memory page size is 4096 bytes Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: detected max file descriptor number: 2048 Nov 12 02:17:36.090705 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: lock engine: pthread robust mutexes Nov 12 02:17:36.091623 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: thunder lock: enabled Nov 12 02:17:36.091623 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 12 02:17:36.091623 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 12 02:17:36.135655 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: Python main interpreter initialized at 0x55dce0f509c0 Nov 12 02:17:36.135655 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: python threads support enabled Nov 12 02:17:36.135655 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: your server socket listen backlog is limited to 100 connections Nov 12 02:17:36.135655 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: your mercy for graceful operations on workers is 90 seconds Nov 12 02:17:36.136007 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: mapped 403077 bytes (393 KB) for 2 cores Nov 12 02:17:36.136103 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: *** Operational MODE: preforking *** Nov 12 02:17:36.136345 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: *** uWSGI is running in multiple interpreter mode *** Nov 12 02:17:36.136345 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: spawned uWSGI master process (pid: 100950) Nov 12 02:17:36.136543 dv-cinder-808574-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 12 02:17:36.137661 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: spawned uWSGI worker 1 (pid: 100951, cores: 1) Nov 12 02:17:36.137661 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: spawned uWSGI worker 2 (pid: 100952, cores: 1) Nov 12 02:17:36.137661 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 12 02:17:37.780783 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 12 02:17:37.780783 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: from cryptography.utils import int_from_bytes Nov 12 02:17:37.781457 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 12 02:17:37.781457 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: from cryptography.utils import int_from_bytes Nov 12 02:17:37.782504 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 12 02:17:37.782504 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: from cryptography.utils import int_from_bytes Nov 12 02:17:37.783004 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 12 02:17:37.783004 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: from cryptography.utils import int_from_bytes Nov 12 02:17:40.322497 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 12 02:17:40.323183 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 12 02:17:40.323271 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 12 02:17:40.323358 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 12 02:17:40.323707 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 12 02:17:40.323790 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 12 02:17:40.323862 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 12 02:17:40.324016 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 12 02:17:40.324200 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.324344 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 12 02:17:40.324520 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.324610 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 12 02:17:40.324837 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.324968 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.325151 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.325292 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.325475 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.325612 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.325777 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.325927 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.326091 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.326252 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.326404 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.326559 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.326745 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.326905 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.327006 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.327221 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.327316 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.327546 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.327633 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-808574-4-iscsi {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.327804 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.327892 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.328114 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.328199 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.328434 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-808574-4-iscsi {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.328528 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.328754 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.328849 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.329060 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.329154 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.329368 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.329456 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.329664 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.329752 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.330526 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.330777 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.331222 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.331222 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.331466 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.331598 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.331855 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.331995 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.332167 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.332317 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.332479 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.332614 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.332779 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.332914 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.333094 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.333226 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.333430 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.333557 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.333687 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.333811 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.333989 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.334131 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.334317 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.334504 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-808574-4-iscsi {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.334716 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.334915 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.335093 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.335287 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.335287 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.335612 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-808574-4-iscsi {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.335612 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.335963 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.336142 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.336328 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.336622 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.336863 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.336863 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.337148 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.337148 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.337398 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.337528 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.337689 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.337816 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.337953 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.338078 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.338211 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.338372 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.338507 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.338640 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.338797 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.338924 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.339046 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.339168 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.339290 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.339412 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.339545 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.339701 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.339826 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.339949 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.340071 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.340201 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.340326 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.340457 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.340679 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.340809 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.340934 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.341065 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.341191 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.341315 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.341447 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.341617 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.341756 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.341910 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.342104 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.342232 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.342421 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.342550 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.342719 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.342850 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.342986 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.343112 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.343236 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.343372 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.343503 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.343628 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.343764 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.343889 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.344012 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.344179 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.344309 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.344481 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.344616 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.344781 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.344910 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.345083 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.345219 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.345394 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.345522 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.345722 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.345849 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.346028 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.346165 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.346328 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.346456 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.346639 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.346836 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.346965 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.347087 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.347272 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.347398 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.347577 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.347714 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.347909 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.348045 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.348206 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.348332 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.348512 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.348649 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.348828 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.348955 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.349144 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.349278 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.349449 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.349588 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.349755 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.349882 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.350061 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.350190 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.350367 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.350500 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.350701 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.350852 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.351002 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.351144 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.351282 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.351408 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.351531 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.351660 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.351812 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.351947 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.352173 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.352318 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.352502 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.352631 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.352754 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.352877 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.353032 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.353163 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.353337 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.353466 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.353641 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.353779 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.353943 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.354070 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.354238 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.354365 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.354537 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.354696 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.354863 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.355001 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.355165 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.355294 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.355466 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.355602 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.355768 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.355894 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.356064 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.356197 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.356367 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.356506 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.356671 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.356806 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.356971 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.357106 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.357272 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.357410 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.357573 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.357701 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.357874 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.358011 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.358177 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.358313 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.358476 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.358609 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.358786 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.358922 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.359107 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.359244 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.359406 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.359535 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.359706 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.359835 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.360016 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.360223 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.360351 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.360481 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.360613 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.360736 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.360944 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.361080 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.361205 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.361329 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.361509 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.361639 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.361820 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.361949 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.362116 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.362257 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.362455 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.362850 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.362987 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.363114 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.363276 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.363404 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.363579 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.363708 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.363883 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.364018 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.364177 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.364310 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.364475 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.364609 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.364767 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.364895 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.365064 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.365191 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.365364 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.365504 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.365660 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.365789 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.365962 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.366088 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.366262 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.366398 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.366574 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.366729 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.366905 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.367043 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.367208 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.367345 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.367531 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:17:40.367661 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.367859 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.368008 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.368214 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.368347 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.368510 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.368639 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.368824 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.368952 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.369156 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.369286 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.369474 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.369600 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.369789 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.369916 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.370095 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.370223 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.370400 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.370528 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.370727 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.370859 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.371079 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.371208 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.371339 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.371464 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.371633 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.371770 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.371952 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.372082 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.372259 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.372398 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.372604 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.372733 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.372866 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.372992 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.373165 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.373302 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.373485 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.373612 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.373794 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.373924 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.374097 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.374225 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.374419 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.374555 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.374758 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.374888 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.375068 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.375199 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.375387 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.375524 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.375694 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.375824 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.376009 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.376138 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.376316 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.376458 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.376624 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.377282 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.377477 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.377661 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.377799 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.378094 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.378230 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.378405 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.378720 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.378865 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.379027 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.379158 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.379362 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.379496 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.379677 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.379803 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.379990 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.380120 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.380295 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.380425 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.380597 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.380730 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.380898 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.381026 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.381232 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.381357 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.381484 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.381607 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.381781 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.381915 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.382098 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.382227 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.382421 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.382560 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.382880 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.383011 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.383145 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.383271 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.383396 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.383614 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.383795 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.383932 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.384059 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.384191 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.384318 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.384455 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.384584 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.384708 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.384839 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.384964 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.385118 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.385257 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.385440 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.385576 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.385737 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.385871 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.386038 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.386173 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.386340 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.386467 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.386638 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.386835 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.386971 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.387096 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.387262 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.387382 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.387568 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.387667 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.387872 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.387963 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.388183 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.388278 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.388487 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.388586 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.388793 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.388889 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.389102 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.389202 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.389433 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.389538 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.389731 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.389825 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.390051 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.390139 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.390371 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.390465 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.390702 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.390872 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.391014 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.391153 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.391399 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.391555 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.391696 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.391834 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.391973 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.392110 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.392248 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.392992 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.393266 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.393411 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.393564 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.393705 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.393853 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.394009 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.394150 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.394288 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.394425 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.394563 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.394777 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.394938 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.395080 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.395226 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.395371 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.395518 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.395669 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.395819 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.395957 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.396094 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.396232 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.396369 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.396518 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.396664 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.396841 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.396984 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.397122 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.397269 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.397417 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.397556 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.397704 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.397843 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.397980 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.398125 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.398273 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.398412 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.398549 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.398739 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.398885 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.399035 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.399174 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.399353 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.399495 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.399643 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.399788 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.399934 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.400082 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.400231 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.400370 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.400508 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.400654 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.400793 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.400931 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.401076 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.401224 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.401390 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.401622 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.401765 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.401765 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.402028 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.402165 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.402302 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.402449 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.402589 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.402754 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.402893 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.403032 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.403180 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.403412 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.403573 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.403712 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.403850 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.403996 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.404141 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.404293 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.404433 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.404579 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.404718 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.404862 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.405009 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.405155 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.405294 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.405442 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.405590 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.405736 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.405883 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.406021 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.406167 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.406306 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.406444 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.406581 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.406757 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.406901 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.407040 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.407195 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.407334 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.407472 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.407619 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.407766 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.407916 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.408098 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.408238 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.408385 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.408532 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.408672 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.408812 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.408956 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.409113 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.409262 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.409403 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.409548 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.409688 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.409827 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.409966 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.410112 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.410263 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.410402 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.410540 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.410726 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.410874 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.411035 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.411175 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.411314 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.411452 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.411614 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.411835 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.411978 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.412116 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.412254 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.412392 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.412529 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.412681 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.412821 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.412980 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.413119 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.413258 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.413414 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.413638 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.413790 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.413932 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.414070 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.414208 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.414345 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.414495 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.414634 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.414799 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.415003 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.415149 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.415300 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.415440 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.415577 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.415722 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.415861 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.416000 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.416152 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.416292 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.416429 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.416567 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.416723 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.416862 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.417009 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.417150 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.417295 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.417434 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.417572 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.417711 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.417857 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.417997 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.418143 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.418311 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.418456 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.418617 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.418772 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.418938 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.419041 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.419258 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.419348 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.419566 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.419664 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.419879 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.419968 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.420186 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.420273 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.420491 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.420586 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.420792 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.420882 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.421099 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.421192 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.421401 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.421488 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.421705 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.421854 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.421992 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.422132 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.422286 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.422435 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.422585 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.422788 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.422940 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.423087 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.423228 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.423366 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.423528 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.423774 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.423926 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.424075 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.424214 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.424353 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.424502 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.424639 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.424784 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.424962 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.425275 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.425418 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.425588 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.425739 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.425901 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.426060 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.426207 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.426346 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.426519 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.426705 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.426862 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.427002 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.427140 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.427277 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.427444 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.427590 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.427736 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.427883 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.428022 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.428166 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.428305 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.428450 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.428608 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.428749 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.428894 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.429033 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.429171 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.429318 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.429457 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.429595 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.429763 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.429907 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.430046 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.430193 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.430343 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.430501 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.430715 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.430860 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.431000 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.431149 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.431299 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.431446 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.431609 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.431764 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.431972 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.432121 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.432260 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.432413 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.432576 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.432716 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.432855 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.433000 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.433140 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.433286 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.433426 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.433571 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.433716 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.433944 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.434089 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.434237 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.434452 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.434604 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.434809 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.434962 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.435102 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.435323 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.435465 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.435604 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.435748 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.435887 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.435887 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.436161 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.436161 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.436433 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.436571 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.436709 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.436709 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.436981 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.437127 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.437273 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.437412 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.437558 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.437706 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.437845 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.437982 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.438132 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.438277 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.438422 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.438569 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.438756 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.438900 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.439047 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.439694 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.439853 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.439999 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.440140 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.440285 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.440424 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.440579 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.440728 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.440867 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.441004 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.441142 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.441280 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.441417 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.441564 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.441703 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.441840 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.441984 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.442124 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.442262 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.442419 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.442559 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.442721 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.442866 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.443022 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.443176 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.443318 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.443463 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.443602 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.443747 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.443886 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.444127 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.444274 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.444425 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.444565 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.444702 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.444840 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.444990 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.445130 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.445267 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.445405 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.445542 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.445680 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.445826 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.445965 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.446114 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.446252 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.446390 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.446537 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.446730 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.446875 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.447023 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.447162 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.447299 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.447445 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.447584 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.447722 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.447859 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.448008 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.448146 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.448296 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.448435 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.448574 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.448711 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.448856 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.449001 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.449152 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.449291 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.449429 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.449574 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.449713 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.449870 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.450016 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.450162 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.450300 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.450438 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.450575 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.450747 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.450892 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.451038 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.451177 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.451314 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.451458 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.451606 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.451760 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.451906 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.452044 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.452182 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.452319 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.452466 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.452606 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.452745 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.452883 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.453037 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.453185 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.453325 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.453462 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.453611 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.453749 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.453919 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.454090 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.454311 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.454456 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.454603 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.454813 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.455476 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.455632 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.455773 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.455912 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.456063 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.456201 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.456346 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.456497 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.456637 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.456783 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.456924 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.457068 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.457208 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.457354 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.457495 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.457632 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.457777 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.457926 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.458075 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.458222 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.458361 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.458499 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.458688 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.458898 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.459062 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.459204 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.459343 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.459480 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.459619 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.459756 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.459913 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.460053 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.460216 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.460360 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.460520 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.460663 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.460811 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.460949 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.461111 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.461257 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.461416 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.461569 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.461708 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.461855 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.461994 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.462131 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.462305 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.462463 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.462603 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.462774 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.462914 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.463060 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.463200 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.463424 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.463566 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.463712 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.463861 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.464007 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.464146 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.464317 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.464537 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.464681 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.464819 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.464956 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.465106 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.465246 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.465392 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.465544 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.465701 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.465846 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.465998 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.466144 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.466289 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.466434 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.466434 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.466755 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.466920 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.467066 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.467218 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.467362 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.467506 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.467660 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.467817 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.467964 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.468156 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.468315 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.468462 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.468614 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.468760 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.468904 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.469048 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.469192 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.469364 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.469520 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.469679 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.469832 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.469832 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.470107 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.470252 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.470406 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.470588 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.470762 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.470920 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.471066 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.471211 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.471387 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.471545 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.471699 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.471844 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.471989 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.472146 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.472299 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.472444 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.472598 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.472745 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.472890 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.473049 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.473199 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.473369 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.473527 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.473527 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.473801 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.473955 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.474100 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.474245 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.474387 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.474548 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.474822 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.474989 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.475136 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.475136 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.475449 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.475615 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.475770 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.475917 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.476062 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.476206 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.476357 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.476502 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.476660 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.476806 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.476958 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.477104 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.477248 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.477470 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.477651 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.477651 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.477929 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.478075 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.478218 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.478363 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.478520 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.478688 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.478840 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.478987 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.479131 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.479289 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.479471 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.479627 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.479774 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.479918 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.480064 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.480221 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.480367 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.480512 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.480656 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.480800 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.481030 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.481188 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.481336 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.481533 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.481681 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.481827 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.481972 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.481972 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.482257 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.482410 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.482557 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.482749 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.482912 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.483067 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.483217 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.483217 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.483523 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.483670 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.483815 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.483815 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.484107 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.484262 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.484416 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.484573 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.484720 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.484951 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.485113 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.485262 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.485418 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.485564 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.485709 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.485853 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.486008 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.486700 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.486866 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.487013 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.487164 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.487373 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.487815 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.487966 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.488111 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.488272 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.488420 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.488578 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.488725 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.488869 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.488869 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.489144 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.489296 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.489451 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.489597 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.489743 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.489895 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.490042 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.490197 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.490351 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.490351 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.490627 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.490627 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.490956 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.490956 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.491241 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.491241 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.491519 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.491664 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.491810 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.491962 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.492119 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.492271 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.492417 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.492561 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.492706 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.492859 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.493060 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.493239 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.493387 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.493387 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.493662 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.493821 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.493986 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.494133 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.494285 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.494432 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.494584 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.494584 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.494907 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.494907 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.495281 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.495435 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.495590 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.495745 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.495893 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.495893 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.496180 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.496180 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.496462 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.496609 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.496754 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.496922 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.497070 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.497216 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.497375 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.497523 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.497668 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.497668 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.497955 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.498100 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.498259 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.498259 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.498534 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.498732 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.498887 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.499045 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.499192 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.499192 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.499484 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.499631 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.499776 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.499940 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.500087 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.500232 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.500377 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.500521 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.500666 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.500819 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.500967 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.501111 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.501256 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.501399 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.501543 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.501751 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.502390 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.502545 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.502715 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.502867 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.503102 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.503102 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.503387 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.503531 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.503676 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.503821 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.503973 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.504121 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.504284 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.504430 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.504575 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.504726 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.504879 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.505026 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.505263 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.505417 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.505562 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.505708 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.505861 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.506008 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.506155 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.506311 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.506457 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.506610 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.506808 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.506956 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.507100 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.507246 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.507391 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.507548 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.507695 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.507848 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.507994 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.508150 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.508295 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.508450 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.508622 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.508817 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.508966 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.509112 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.509266 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.509415 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.509568 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.509716 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.509861 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.510021 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.510176 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.510324 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.510470 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.510616 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.510790 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.510955 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.511103 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.511248 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.511393 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.511539 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.511697 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.511852 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.511998 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.512143 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.512295 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.512448 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.512604 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.512752 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.512897 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.513049 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.513197 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.513343 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.513501 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.513665 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.513819 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.513973 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.514120 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.514266 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.514419 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.514573 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.514768 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.514921 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.515067 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.515213 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.515463 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.515634 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.515783 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.515929 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.516073 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.516231 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.516385 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.516532 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.516678 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.516830 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.516976 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.517130 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.517277 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.517451 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.517607 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.517753 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.517899 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.518053 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.518200 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.518345 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.518497 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.518643 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.518830 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.518978 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.519122 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.519122 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.519414 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.519591 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.519752 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.519899 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.520045 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.520196 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.520349 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.520494 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.520648 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.520795 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.520941 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.521086 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.521230 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.521385 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.521540 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.521685 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.521831 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.521983 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.522129 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.522129 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.522414 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.522560 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.522743 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.522896 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.523049 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.523049 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.523358 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.523511 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.523674 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.523820 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.523971 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.524127 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.524320 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.524524 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.524725 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.524876 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.525030 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.525187 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.525384 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.525623 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.525784 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.525938 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.526097 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.526245 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.526392 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.526537 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.526706 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.526860 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.527021 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.527174 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.527322 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.527485 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.527632 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.527777 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.527930 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.528076 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.528223 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.528376 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.528522 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.528667 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.528821 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.528975 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.529122 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.529267 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.529423 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.529582 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.529731 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.529876 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.530021 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.530165 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.530317 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.530472 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.530626 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.530801 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.530958 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.531105 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.531250 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.531480 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.531629 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.531774 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.531927 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.532073 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.532218 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.532372 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.532526 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.532679 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.532832 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.533019 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.533179 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.533332 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.533494 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.533640 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.533785 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.533937 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.534092 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.534246 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.534392 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.534545 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.534740 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.534893 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.535051 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.535198 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.535426 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.535577 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.535815 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.535974 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.536134 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.536281 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.536427 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.536580 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.536735 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.536735 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.537022 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.537168 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.537313 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.537469 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.537614 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.537614 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.537900 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.538045 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.538198 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.538344 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.538489 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.538641 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.538819 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.538965 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.539110 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.539255 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.539411 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.539571 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.539726 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.539873 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.540019 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.540170 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.540324 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.540471 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.540617 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.540762 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.540916 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.541061 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.541226 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.541372 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.541524 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.541676 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.541829 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.541975 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.542133 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.542279 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.542424 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.542568 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.542764 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.542933 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.543092 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.543249 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.543395 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.543540 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.543685 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.543837 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.543985 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.544129 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.544281 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.544426 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.544572 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.544725 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.544872 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.545031 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.545176 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.545327 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.545483 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.545630 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.545799 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.546018 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.546172 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.546316 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.546475 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.546624 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.546798 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.546944 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.547110 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.547256 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.547411 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.547565 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.547718 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.547863 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.548009 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.548164 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.548335 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.548483 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.549369 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.549525 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.549691 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.549848 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.549996 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.550142 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.550288 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.550433 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.550590 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.550802 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.550955 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.551128 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.551278 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.551425 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.551583 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.551742 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.551897 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.552049 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.552203 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.552350 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.552504 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.552663 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.552810 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.552956 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.553101 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.553245 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.553400 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.553574 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.553729 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.553887 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.554034 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.554179 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.554333 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.554480 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.554634 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.554789 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.554889 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.554993 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.555083 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.555166 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.555247 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.555327 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.555408 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.555503 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.555503 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.555711 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.555803 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.555900 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.555982 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.556069 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.556140 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.556207 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.556272 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.556337 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.556501 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.556608 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.556785 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.556884 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.557084 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.557174 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.557393 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.557555 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.557706 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.557851 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.558007 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.558153 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.558310 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.558457 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.558609 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.558869 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.559017 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.559162 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.559386 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.559545 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.559694 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.559846 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.559846 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.560156 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.560304 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.560449 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.560601 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.560748 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.560899 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.561058 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.561204 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.561356 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.561510 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.561657 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.561657 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.561959 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.562107 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.562267 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.562413 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.562557 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.562742 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.562896 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.563042 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.563185 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.563331 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.563475 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.563629 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.563780 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.563938 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.564084 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.564290 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.564932 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.565102 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100951) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 12 02:17:40.565252 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.565397 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.565617 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.565922 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:17:40.566168 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100952) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 12 02:17:40.588157 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG oslo_db.sqlalchemy.engines [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:17:40.590056 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_db.sqlalchemy.engines [None req-327d309c-95c6-4807-a164-869c2ee99f5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:17:40.655266 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.context [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6(cell1) {{(pid=100951) load_cells /opt/stack/nova/nova/context.py:464}} Nov 12 02:17:40.656774 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.context [None req-327d309c-95c6-4807-a164-869c2ee99f5f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6(cell1) {{(pid=100952) load_cells /opt/stack/nova/nova/context.py:464}} Nov 12 02:17:40.659390 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG oslo_concurrency.lockutils [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:17:40.660922 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-327d309c-95c6-4807-a164-869c2ee99f5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:17:40.661033 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG oslo_concurrency.lockutils [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:17:40.661744 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG oslo_concurrency.lockutils [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:17:40.662528 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-327d309c-95c6-4807-a164-869c2ee99f5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:17:40.663351 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-327d309c-95c6-4807-a164-869c2ee99f5f None None] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:17:40.663693 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG oslo_concurrency.lockutils [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100951) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:17:40.665408 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-327d309c-95c6-4807-a164-869c2ee99f5f None None] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:17:40.675755 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG oslo_db.sqlalchemy.engines [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:17:40.677194 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG oslo_db.sqlalchemy.engines [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:17:40.680344 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_db.sqlalchemy.engines [None req-327d309c-95c6-4807-a164-869c2ee99f5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:17:40.682566 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_db.sqlalchemy.engines [None req-327d309c-95c6-4807-a164-869c2ee99f5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:17:40.939796 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG oslo_db.sqlalchemy.engines [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100951) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:17:40.945893 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_db.sqlalchemy.engines [None req-327d309c-95c6-4807-a164-869c2ee99f5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100952) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:17:41.279348 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: WARNING keystonemiddleware.auth_token [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 12 02:17:41.282960 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: WARNING keystonemiddleware.auth_token [None req-327d309c-95c6-4807-a164-869c2ee99f5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 12 02:17:41.285814 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: WARNING keystonemiddleware.auth_token [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 12 02:17:41.289487 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: WARNING keystonemiddleware.auth_token [None req-327d309c-95c6-4807-a164-869c2ee99f5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 12 02:17:41.510265 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: WARNING keystonemiddleware.auth_token [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 12 02:17:41.514300 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: WARNING keystonemiddleware.auth_token [None req-327d309c-95c6-4807-a164-869c2ee99f5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 12 02:17:41.515458 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: WARNING keystonemiddleware.auth_token [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 12 02:17:41.519489 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: WARNING keystonemiddleware.auth_token [None req-327d309c-95c6-4807-a164-869c2ee99f5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 12 02:17:41.520790 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dce0f509c0 pid: 100951 (default app) Nov 12 02:17:41.522861 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:17:41.524023 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001741 Nov 12 02:17:41.524441 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Fri Nov 12 02:17:41 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:17:41.524820 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dce0f509c0 pid: 100952 (default app) Nov 12 02:19:02.733432 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:02.734433 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 12 02:19:02.734863 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 2/2] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:19:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:19:03.321379 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-1ae857e8-d89d-4303-9bf9-6b4fbfb46674 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:03.350602 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-1ae857e8-d89d-4303-9bf9-6b4fbfb46674 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.606253 Nov 12 02:19:03.351395 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 1/3] 10.222.0.70 () {60 vars in 1291 bytes} [Fri Nov 12 02:19:02 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:19:05.711212 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:05.712216 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-8ecc13c9-69e3-435c-8bd4-c6e74b803fe4 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Nov 12 02:19:05.712781 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 3/4] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:19:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:19:05.781137 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-269e28f3-f8e9-4571-926b-9e755136389e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "id": "c1", "vcpus": 1, "name": "cirros256"}} {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:05.799494 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:19:05.799494 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: warnings.warn(msg) Nov 12 02:19:05.833673 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-269e28f3-f8e9-4571-926b-9e755136389e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.113339 Nov 12 02:19:05.842462 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 2/5] 10.222.0.70 () {64 vars in 1282 bytes} [Fri Nov 12 02:19:05 2021] POST /compute/v2.1/flavors => generated 407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:19:06.196670 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-84784f51-1a03-4de2-9e0d-88ba2f4ec2d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:06.199026 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:19:06.199026 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: warnings.warn(msg) Nov 12 02:19:06.249030 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-84784f51-1a03-4de2-9e0d-88ba2f4ec2d2 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.404641 Nov 12 02:19:06.249629 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 4/6] 10.222.0.70 () {64 vars in 1335 bytes} [Fri Nov 12 02:19:05 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:19:08.606256 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-269e28f3-f8e9-4571-926b-9e755136389e admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:08.608333 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-269e28f3-f8e9-4571-926b-9e755136389e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002488 Nov 12 02:19:08.609046 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 3/7] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:19:08 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:19:08.733308 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-968f25e0-c109-450b-af31-af4c7b5886dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 512}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:08.751853 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:19:08.751853 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: warnings.warn(msg) Nov 12 02:19:08.773095 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-968f25e0-c109-450b-af31-af4c7b5886dd admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156333 Nov 12 02:19:08.778731 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 5/8] 10.222.0.70 () {64 vars in 1282 bytes} [Fri Nov 12 02:19:08 2021] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:19:08.786762 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-4a7e9826-dbca-4f03-b43a-05d3f5072830 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:08.788653 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:19:08.788653 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: warnings.warn(msg) Nov 12 02:19:08.823721 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-4a7e9826-dbca-4f03-b43a-05d3f5072830 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040811 Nov 12 02:19:08.824621 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 4/9] 10.222.0.70 () {64 vars in 1335 bytes} [Fri Nov 12 02:19:08 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:19:11.145101 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-968f25e0-c109-450b-af31-af4c7b5886dd admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:11.146434 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-968f25e0-c109-450b-af31-af4c7b5886dd admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Nov 12 02:19:11.152511 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 6/10] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:19:11 2021] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:19:11.217543 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-e7de35f4-0564-4be6-8efa-5edab1b1f9ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "swap": 0, "id": "d2", "name": "ds1G", "vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:11.238055 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-e7de35f4-0564-4be6-8efa-5edab1b1f9ec admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083821 Nov 12 02:19:11.251665 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-13e72ede-a4db-443e-b622-bbbb6ee4f88d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:11.254831 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 5/11] 10.222.0.70 () {64 vars in 1282 bytes} [Fri Nov 12 02:19:11 2021] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:19:11.276310 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-13e72ede-a4db-443e-b622-bbbb6ee4f88d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028720 Nov 12 02:19:11.277069 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 7/12] 10.222.0.70 () {64 vars in 1335 bytes} [Fri Nov 12 02:19:11 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:19:13.625392 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-e7de35f4-0564-4be6-8efa-5edab1b1f9ec admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:13.626437 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-e7de35f4-0564-4be6-8efa-5edab1b1f9ec admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Nov 12 02:19:13.626952 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 6/13] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:19:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:19:13.697063 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-7f0b6c27-4032-4eb0-b194-e7f49c8a4dca admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:13.717424 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-7f0b6c27-4032-4eb0-b194-e7f49c8a4dca admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076850 Nov 12 02:19:13.717938 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 8/14] 10.222.0.70 () {64 vars in 1282 bytes} [Fri Nov 12 02:19:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:19:13.730129 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-a4ba321f-1eef-4b5c-946b-19740e98f67a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:13.751510 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-a4ba321f-1eef-4b5c-946b-19740e98f67a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024990 Nov 12 02:19:13.752050 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 7/15] 10.222.0.70 () {64 vars in 1335 bytes} [Fri Nov 12 02:19:13 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:19:16.105059 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-7f0b6c27-4032-4eb0-b194-e7f49c8a4dca admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:16.106044 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-7f0b6c27-4032-4eb0-b194-e7f49c8a4dca admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Nov 12 02:19:16.106434 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 9/16] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:19:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:19:16.186968 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-2dc78582-f512-4f57-b095-099a15c9e63e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:16.207496 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-2dc78582-f512-4f57-b095-099a15c9e63e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094141 Nov 12 02:19:16.208780 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 8/17] 10.222.0.70 () {64 vars in 1282 bytes} [Fri Nov 12 02:19:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:19:16.220902 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-e7c1e565-f206-4c61-be9a-c3f883ec5337 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:16.245904 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-e7c1e565-f206-4c61-be9a-c3f883ec5337 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028483 Nov 12 02:19:16.247385 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 10/18] 10.222.0.70 () {64 vars in 1335 bytes} [Fri Nov 12 02:19:16 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:19:18.990058 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-2dc78582-f512-4f57-b095-099a15c9e63e admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:18.992008 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-2dc78582-f512-4f57-b095-099a15c9e63e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002097 Nov 12 02:19:18.992527 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 9/19] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:19:18 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:19:19.061469 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-9b58c7ae-bc7b-469f-b1c5-86a42587b655 admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:19.085103 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-9b58c7ae-bc7b-469f-b1c5-86a42587b655 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083640 Nov 12 02:19:19.085651 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 11/20] 10.222.0.70 () {60 vars in 1291 bytes} [Fri Nov 12 02:19:19 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:19:21.460263 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-2dc78582-f512-4f57-b095-099a15c9e63e admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:21.461560 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-2dc78582-f512-4f57-b095-099a15c9e63e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001887 Nov 12 02:19:21.462050 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 10/21] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:19:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:19:21.523603 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-fef7b1ed-f3d7-4e68-a252-3a66605ce561 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "id": "1", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:21.547325 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-fef7b1ed-f3d7-4e68-a252-3a66605ce561 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078388 Nov 12 02:19:21.547868 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 12/22] 10.222.0.70 () {64 vars in 1282 bytes} [Fri Nov 12 02:19:21 2021] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:19:21.560208 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-c2429bdb-c21b-42e4-9141-831d0e7b415b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:21.581983 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-c2429bdb-c21b-42e4-9141-831d0e7b415b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025358 Nov 12 02:19:21.582531 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 11/23] 10.222.0.70 () {64 vars in 1332 bytes} [Fri Nov 12 02:19:21 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:19:23.902174 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-fef7b1ed-f3d7-4e68-a252-3a66605ce561 admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:23.903151 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-fef7b1ed-f3d7-4e68-a252-3a66605ce561 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Nov 12 02:19:23.903500 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 13/24] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:19:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:19:23.969659 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-ea7d7919-1711-4d1b-9018-f44164755b54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "id": "2"}} {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:23.989829 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-ea7d7919-1711-4d1b-9018-f44164755b54 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074216 Nov 12 02:19:23.990384 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 12/25] 10.222.0.70 () {64 vars in 1282 bytes} [Fri Nov 12 02:19:23 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:19:24.005075 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-194b9301-32ee-479a-b635-3f6dfe2de593 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:24.029292 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-194b9301-32ee-479a-b635-3f6dfe2de593 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027747 Nov 12 02:19:24.030034 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 14/26] 10.222.0.70 () {64 vars in 1332 bytes} [Fri Nov 12 02:19:24 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:19:26.347097 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-ea7d7919-1711-4d1b-9018-f44164755b54 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:26.348102 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-ea7d7919-1711-4d1b-9018-f44164755b54 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Nov 12 02:19:26.348700 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 13/27] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:19:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:19:26.407215 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-6ec8bec0-820c-4212-b845-984d08be3f1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:26.425236 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-6ec8bec0-820c-4212-b845-984d08be3f1e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070040 Nov 12 02:19:26.425804 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 15/28] 10.222.0.70 () {64 vars in 1282 bytes} [Fri Nov 12 02:19:26 2021] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:19:26.438718 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-52b0b9e1-5a60-4992-a682-9c9bfe7a25d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:26.460401 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-52b0b9e1-5a60-4992-a682-9c9bfe7a25d9 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025854 Nov 12 02:19:26.460968 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 14/29] 10.222.0.70 () {64 vars in 1332 bytes} [Fri Nov 12 02:19:26 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:19:28.788877 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-6ec8bec0-820c-4212-b845-984d08be3f1e admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:28.789876 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-6ec8bec0-820c-4212-b845-984d08be3f1e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Nov 12 02:19:28.790281 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 16/30] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:19:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:19:28.849771 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-76a4f03d-944a-4bf5-b66a-dee6de2d9074 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "disk": 80, "vcpus": 4}} {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:28.871146 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-76a4f03d-944a-4bf5-b66a-dee6de2d9074 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073705 Nov 12 02:19:28.871698 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 15/31] 10.222.0.70 () {64 vars in 1282 bytes} [Fri Nov 12 02:19:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:19:28.884900 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-aa97a29b-5b85-4542-9b50-d86754051869 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:28.933404 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-aa97a29b-5b85-4542-9b50-d86754051869 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050892 Nov 12 02:19:28.934320 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 17/32] 10.222.0.70 () {64 vars in 1332 bytes} [Fri Nov 12 02:19:28 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:19:31.327456 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-76a4f03d-944a-4bf5-b66a-dee6de2d9074 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:19:31.329183 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-76a4f03d-944a-4bf5-b66a-dee6de2d9074 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002719 Nov 12 02:19:31.330078 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 16/33] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:19:31 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:19:31.395800 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-0d731e02-21c5-47fa-a85c-35f2b3b2c729 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "id": "5"}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:31.417344 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-0d731e02-21c5-47fa-a85c-35f2b3b2c729 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080744 Nov 12 02:19:31.417892 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 18/34] 10.222.0.70 () {64 vars in 1282 bytes} [Fri Nov 12 02:19:31 2021] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:19:31.436136 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-02ca2d9e-7a2c-4d1e-a9a2-c8f462a19851 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:19:31.460738 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-02ca2d9e-7a2c-4d1e-a9a2-c8f462a19851 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028681 Nov 12 02:19:31.461313 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 17/35] 10.222.0.70 () {64 vars in 1332 bytes} [Fri Nov 12 02:19:31 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:20:11.808068 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-0d731e02-21c5-47fa-a85c-35f2b3b2c729 admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:11.809052 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-0d731e02-21c5-47fa-a85c-35f2b3b2c729 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Nov 12 02:20:11.809450 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 19/36] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:20:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:20:11.875102 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-8dc72890-af95-4986-a1f7-678bb8dbcc96 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:11.891557 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-8dc72890-af95-4986-a1f7-678bb8dbcc96 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068848 Nov 12 02:20:11.892086 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 18/37] 10.222.0.70 () {60 vars in 1291 bytes} [Fri Nov 12 02:20:11 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:20:13.424026 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-0d731e02-21c5-47fa-a85c-35f2b3b2c729 admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:13.425018 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-0d731e02-21c5-47fa-a85c-35f2b3b2c729 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Nov 12 02:20:13.425415 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 20/38] 10.222.0.70 () {56 vars in 1074 bytes} [Fri Nov 12 02:20:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:20:13.619186 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-5bd2bf0b-8970-4b01-a756-be2415fbb1f0 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:13.624621 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.wsgi [None req-5bd2bf0b-8970-4b01-a756-be2415fbb1f0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 12 02:20:13.625182 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-5bd2bf0b-8970-4b01-a756-be2415fbb1f0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:20:13.625965 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-5bd2bf0b-8970-4b01-a756-be2415fbb1f0 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058936 Nov 12 02:20:13.626485 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 19/39] 10.222.0.70 () {60 vars in 1190 bytes} [Fri Nov 12 02:20:13 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 12 02:20:13.636402 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-3b659c99-1ca5-4df8-a736-08ff1fad60e7 admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:13.657501 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-3b659c99-1ca5-4df8-a736-08ff1fad60e7 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024590 Nov 12 02:20:13.658038 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 21/40] 10.222.0.70 () {60 vars in 1210 bytes} [Fri Nov 12 02:20:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:20:13.668212 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-4ff77af2-49ed-4284-9a63-759739ef8ee9 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:13.690513 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-4ff77af2-49ed-4284-9a63-759739ef8ee9 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025746 Nov 12 02:20:13.691080 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 20/41] 10.222.0.70 () {60 vars in 1210 bytes} [Fri Nov 12 02:20:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:20:13.701505 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-e284279a-531d-476b-96ca-8be644046595 admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:13.706911 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.wsgi [None req-e284279a-531d-476b-96ca-8be644046595 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 12 02:20:13.707564 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-e284279a-531d-476b-96ca-8be644046595 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:20:13.708335 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-e284279a-531d-476b-96ca-8be644046595 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010910 Nov 12 02:20:13.708828 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 22/42] 10.222.0.70 () {60 vars in 1190 bytes} [Fri Nov 12 02:20:13 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 12 02:20:15.138553 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-4ff77af2-49ed-4284-9a63-759739ef8ee9 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:15.139584 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-4ff77af2-49ed-4284-9a63-759739ef8ee9 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Nov 12 02:20:15.139982 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 21/43] 10.222.0.70 () {56 vars in 1074 bytes} [Fri Nov 12 02:20:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:20:15.331657 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-486fc5fe-620d-401f-9c2b-9a6bd6ccc2b1 admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:15.338487 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.wsgi [None req-486fc5fe-620d-401f-9c2b-9a6bd6ccc2b1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 12 02:20:15.339062 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-486fc5fe-620d-401f-9c2b-9a6bd6ccc2b1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:20:15.339825 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-486fc5fe-620d-401f-9c2b-9a6bd6ccc2b1 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058919 Nov 12 02:20:15.340313 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 23/44] 10.222.0.70 () {60 vars in 1190 bytes} [Fri Nov 12 02:20:15 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 12 02:20:15.350677 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-17bf02b4-341f-4601-8bc4-7f7e3112b5c8 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:15.364030 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-17bf02b4-341f-4601-8bc4-7f7e3112b5c8 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017021 Nov 12 02:20:15.364557 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 22/45] 10.222.0.70 () {60 vars in 1210 bytes} [Fri Nov 12 02:20:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:20:15.374588 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-1b31327d-99bd-440c-b663-bdeac0bca2b3 admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:15.387598 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-1b31327d-99bd-440c-b663-bdeac0bca2b3 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016841 Nov 12 02:20:15.388766 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 24/46] 10.222.0.70 () {60 vars in 1210 bytes} [Fri Nov 12 02:20:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:20:15.397989 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-74bc08b6-4c2d-4cb1-8b57-f89d0cf6bb3d admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:15.403047 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.wsgi [None req-74bc08b6-4c2d-4cb1-8b57-f89d0cf6bb3d admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 12 02:20:15.403699 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-74bc08b6-4c2d-4cb1-8b57-f89d0cf6bb3d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:20:15.404451 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-74bc08b6-4c2d-4cb1-8b57-f89d0cf6bb3d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009859 Nov 12 02:20:15.404939 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 23/47] 10.222.0.70 () {60 vars in 1190 bytes} [Fri Nov 12 02:20:15 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 12 02:20:16.825411 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-1b31327d-99bd-440c-b663-bdeac0bca2b3 admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:16.826408 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-1b31327d-99bd-440c-b663-bdeac0bca2b3 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Nov 12 02:20:16.826841 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 25/48] 10.222.0.70 () {56 vars in 1074 bytes} [Fri Nov 12 02:20:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:20:17.018560 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-ee92e138-8999-47c7-a34b-fc534ae97ed3 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:17.023785 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.wsgi [None req-ee92e138-8999-47c7-a34b-fc534ae97ed3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 12 02:20:17.024337 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-ee92e138-8999-47c7-a34b-fc534ae97ed3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100952) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:20:17.025115 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-ee92e138-8999-47c7-a34b-fc534ae97ed3 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057709 Nov 12 02:20:17.025613 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 24/49] 10.222.0.70 () {60 vars in 1193 bytes} [Fri Nov 12 02:20:16 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 12 02:20:17.035892 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-e0e6e4eb-c55d-4490-9c47-c58b1fdf021e admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:17.049423 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-e0e6e4eb-c55d-4490-9c47-c58b1fdf021e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017114 Nov 12 02:20:17.049931 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 26/50] 10.222.0.70 () {60 vars in 1210 bytes} [Fri Nov 12 02:20:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:20:17.059946 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:17.072526 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016475 Nov 12 02:20:17.073037 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 25/51] 10.222.0.70 () {60 vars in 1210 bytes} [Fri Nov 12 02:20:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:20:17.082508 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-52ffaedc-9d50-4dac-baab-963710a0f1fe admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:17.087470 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.wsgi [None req-52ffaedc-9d50-4dac-baab-963710a0f1fe admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 12 02:20:17.088055 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-52ffaedc-9d50-4dac-baab-963710a0f1fe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100951) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:20:17.088828 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-52ffaedc-9d50-4dac-baab-963710a0f1fe admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009789 Nov 12 02:20:17.089347 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 27/52] 10.222.0.70 () {60 vars in 1193 bytes} [Fri Nov 12 02:20:17 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 12 02:20:18.514893 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:18.515920 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Nov 12 02:20:18.516313 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 26/53] 10.222.0.70 () {56 vars in 1074 bytes} [Fri Nov 12 02:20:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:20:18.714257 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-55a97183-b963-48c3-8c82-fe4e4e89f913 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:20:18.732643 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-55a97183-b963-48c3-8c82-fe4e4e89f913 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.073043 Nov 12 02:20:18.733108 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 28/54] 10.222.0.70 () {64 vars in 1235 bytes} [Fri Nov 12 02:20:18 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:20:20.292802 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:20.294315 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001394 Nov 12 02:20:20.294736 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 27/55] 10.222.0.70 () {56 vars in 1074 bytes} [Fri Nov 12 02:20:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:20:20.486877 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-f6296365-b7df-450e-b3b4-e6c410ca57f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:20:20.504680 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-f6296365-b7df-450e-b3b4-e6c410ca57f2 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067646 Nov 12 02:20:20.505217 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 29/56] 10.222.0.70 () {64 vars in 1235 bytes} [Fri Nov 12 02:20:20 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:20:21.932649 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:21.933640 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Nov 12 02:20:21.934032 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 28/57] 10.222.0.70 () {56 vars in 1074 bytes} [Fri Nov 12 02:20:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:20:22.156508 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-af651c89-d4ac-490d-976b-959f2244efa9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:20:22.175803 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-af651c89-d4ac-490d-976b-959f2244efa9 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.102716 Nov 12 02:20:22.176352 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 30/58] 10.222.0.70 () {64 vars in 1235 bytes} [Fri Nov 12 02:20:22 2021] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:20:23.599989 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:23.600988 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001394 Nov 12 02:20:23.601383 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 29/59] 10.222.0.70 () {56 vars in 1074 bytes} [Fri Nov 12 02:20:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:20:23.795277 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-0aaa8b7a-2c24-482e-9d10-b239a4b96937 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:20:23.812327 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-0aaa8b7a-2c24-482e-9d10-b239a4b96937 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068845 Nov 12 02:20:23.812787 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 31/60] 10.222.0.70 () {64 vars in 1235 bytes} [Fri Nov 12 02:20:23 2021] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:20:25.226497 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:25.228091 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001848 Nov 12 02:20:25.228531 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 30/61] 10.222.0.70 () {56 vars in 1074 bytes} [Fri Nov 12 02:20:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:20:25.419801 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-0130d295-e8c3-4101-a2be-39f6b6697c7d admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:20:25.438793 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-0130d295-e8c3-4101-a2be-39f6b6697c7d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069929 Nov 12 02:20:25.439329 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 32/62] 10.222.0.70 () {60 vars in 1202 bytes} [Fri Nov 12 02:20:25 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:21:12.071083 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:21:12.072055 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-f12abeea-ab3a-4470-80db-8adb9830788b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Nov 12 02:21:12.072452 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 31/63] 10.222.0.70 () {54 vars in 930 bytes} [Fri Nov 12 02:21:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:21:12.131422 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-f8078592-0bb9-481b-9945-3faf9c3c8bb8 admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:21:12.150540 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-f8078592-0bb9-481b-9945-3faf9c3c8bb8 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069839 Nov 12 02:21:12.151114 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 33/64] 10.222.0.70 () {60 vars in 1291 bytes} [Fri Nov 12 02:21:12 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:21:12.173382 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-3f3b8a25-20d6-479f-8474-327e4679b540 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:21:12.180979 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-3f3b8a25-20d6-479f-8474-327e4679b540 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011177 Nov 12 02:21:12.181488 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 32/65] 10.222.0.70 () {60 vars in 1282 bytes} [Fri Nov 12 02:21:12 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:21:12.193513 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-5249e738-e5fd-4804-86b9-16c2674284ff admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:21:12.200961 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-5249e738-e5fd-4804-86b9-16c2674284ff admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010876 Nov 12 02:21:12.201465 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 34/66] 10.222.0.70 () {60 vars in 1285 bytes} [Fri Nov 12 02:21:12 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:21:12.212873 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-e9870a27-6986-4774-8dac-80782ad2b063 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:21:12.220158 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-e9870a27-6986-4774-8dac-80782ad2b063 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010655 Nov 12 02:21:12.220663 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 33/67] 10.222.0.70 () {60 vars in 1285 bytes} [Fri Nov 12 02:21:12 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:21:12.232315 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-86a4edef-b62c-42a1-975b-6c3c8b050c8f admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:21:12.239767 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-86a4edef-b62c-42a1-975b-6c3c8b050c8f admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011017 Nov 12 02:21:12.240278 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 35/68] 10.222.0.70 () {60 vars in 1282 bytes} [Fri Nov 12 02:21:12 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:22:34.850025 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-9cb74a5b-37e1-45d1-a49b-4866048ec3dd tempest-verify_tempest_config-209091652 tempest-verify_tempest_config-209091652-project] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:22:34.852000 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-9cb74a5b-37e1-45d1-a49b-4866048ec3dd tempest-verify_tempest_config-209091652 tempest-verify_tempest_config-209091652-project] 10.222.0.70 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105254 Nov 12 02:22:34.852518 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 34/69] 10.222.0.70 () {58 vars in 1133 bytes} [Fri Nov 12 02:22:34 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:24:10.415587 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-86a4edef-b62c-42a1-975b-6c3c8b050c8f admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:24:10.416570 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-86a4edef-b62c-42a1-975b-6c3c8b050c8f admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Nov 12 02:24:10.416960 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 36/70] 10.222.0.70 () {56 vars in 1074 bytes} [Fri Nov 12 02:24:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:24:10.675832 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-d4cb8d0d-1751-49b6-a7e3-c843002a48e7 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:24:10.677050 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:24:10.677050 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: warnings.warn(msg) Nov 12 02:24:10.678615 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-d4cb8d0d-1751-49b6-a7e3-c843002a48e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:24:10.679081 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-d4cb8d0d-1751-49b6-a7e3-c843002a48e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:24:10.679874 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-d4cb8d0d-1751-49b6-a7e3-c843002a48e7 admin admin] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:24:10.680297 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-d4cb8d0d-1751-49b6-a7e3-c843002a48e7 admin admin] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:24:10.714473 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-d4cb8d0d-1751-49b6-a7e3-c843002a48e7 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.157172 Nov 12 02:24:10.715070 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 35/71] 10.222.0.70 () {60 vars in 1193 bytes} [Fri Nov 12 02:24:10 2021] GET /compute/v2.1/os-services => generated 791 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:24:12.136606 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-86a4edef-b62c-42a1-975b-6c3c8b050c8f admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:24:12.137597 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-86a4edef-b62c-42a1-975b-6c3c8b050c8f admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 Nov 12 02:24:12.137988 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 37/72] 10.222.0.70 () {56 vars in 1074 bytes} [Fri Nov 12 02:24:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:24:12.329363 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-8641fe1e-0a9a-4af8-8cc4-332556cfcb90 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:24:12.330514 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:24:12.330514 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: warnings.warn(msg) Nov 12 02:24:12.332109 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-8641fe1e-0a9a-4af8-8cc4-332556cfcb90 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:24:12.332550 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-8641fe1e-0a9a-4af8-8cc4-332556cfcb90 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:24:12.333368 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-8641fe1e-0a9a-4af8-8cc4-332556cfcb90 admin admin] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:24:12.333796 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-8641fe1e-0a9a-4af8-8cc4-332556cfcb90 admin admin] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:24:12.352268 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-8641fe1e-0a9a-4af8-8cc4-332556cfcb90 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074768 Nov 12 02:24:12.353349 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 36/73] 10.222.0.70 () {60 vars in 1193 bytes} [Fri Nov 12 02:24:12 2021] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:24:24.229453 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-86a4edef-b62c-42a1-975b-6c3c8b050c8f admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:24:24.230428 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-86a4edef-b62c-42a1-975b-6c3c8b050c8f admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Nov 12 02:24:24.230846 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 38/74] 10.222.0.70 () {56 vars in 1074 bytes} [Fri Nov 12 02:24:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:24:24.425623 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-5a26d5ad-4d30-41a8-bfe5-1fb72c7f3bb0 admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:24:24.426834 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:24:24.426834 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: warnings.warn(msg) Nov 12 02:24:24.428390 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-5a26d5ad-4d30-41a8-bfe5-1fb72c7f3bb0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:24:24.428831 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-5a26d5ad-4d30-41a8-bfe5-1fb72c7f3bb0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:24:24.429622 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-5a26d5ad-4d30-41a8-bfe5-1fb72c7f3bb0 admin admin] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:24:24.430049 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-5a26d5ad-4d30-41a8-bfe5-1fb72c7f3bb0 admin admin] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:24:24.454042 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-5a26d5ad-4d30-41a8-bfe5-1fb72c7f3bb0 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080280 Nov 12 02:24:24.454580 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 37/75] 10.222.0.70 () {60 vars in 1193 bytes} [Fri Nov 12 02:24:24 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:24:25.891547 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: DEBUG nova.api.openstack.wsgi [None req-86a4edef-b62c-42a1-975b-6c3c8b050c8f admin admin] Calling method '>' {{(pid=100951) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:24:25.892529 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: INFO nova.api.openstack.requestlog [None req-86a4edef-b62c-42a1-975b-6c3c8b050c8f admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Nov 12 02:24:25.892921 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: [pid: 100951|app: 0|req: 39/76] 10.222.0.70 () {56 vars in 1074 bytes} [Fri Nov 12 02:24:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:24:26.085763 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG nova.api.openstack.wsgi [None req-31232000-38c7-47dd-a125-e315fe77c6de admin admin] Calling method '>' {{(pid=100952) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:24:26.086981 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:24:26.086981 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: warnings.warn(msg) Nov 12 02:24:26.088492 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-31232000-38c7-47dd-a125-e315fe77c6de admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:24:26.088930 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-31232000-38c7-47dd-a125-e315fe77c6de admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:24:26.089749 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-31232000-38c7-47dd-a125-e315fe77c6de admin admin] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:24:26.090171 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: DEBUG oslo_concurrency.lockutils [None req-31232000-38c7-47dd-a125-e315fe77c6de admin admin] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100952) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:24:26.111522 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: INFO nova.api.openstack.requestlog [None req-31232000-38c7-47dd-a125-e315fe77c6de admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076970 Nov 12 02:24:26.111998 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: [pid: 100952|app: 0|req: 38/77] 10.222.0.70 () {60 vars in 1193 bytes} [Fri Nov 12 02:24:26 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:25:26.260231 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: Fri Nov 12 02:25:26 2021 - graceful shutdown triggered... Nov 12 02:25:26.260733 dv-cinder-808574-4-iscsi devstack@n-api.service[100952]: Gracefully killing worker 2 (pid: 100952)... Nov 12 02:25:26.260346 dv-cinder-808574-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 12 02:25:26.261506 dv-cinder-808574-4-iscsi devstack@n-api.service[100951]: Gracefully killing worker 1 (pid: 100951)... Nov 12 02:25:27.261336 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: worker 1 buried after 1 seconds Nov 12 02:25:27.261336 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: worker 2 buried after 1 seconds Nov 12 02:25:27.261336 dv-cinder-808574-4-iscsi devstack@n-api.service[100950]: goodbye to uWSGI. Nov 12 02:25:27.262945 dv-cinder-808574-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 12 02:25:27.263495 dv-cinder-808574-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 12 02:25:27.266241 dv-cinder-808574-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 12 02:25:27.276249 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 12 02:25:27.278852 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Nov 12 02:25:27 2021] *** Nov 12 02:25:27.278852 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 12 02:25:27.278852 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 12 02:25:27.278852 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: nodename: dv-cinder-808574-4-iscsi Nov 12 02:25:27.278852 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: machine: x86_64 Nov 12 02:25:27.279258 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: clock source: unix Nov 12 02:25:27.279258 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: pcre jit disabled Nov 12 02:25:27.279258 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: detected number of CPU cores: 4 Nov 12 02:25:27.279258 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: current working directory: / Nov 12 02:25:27.279258 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: detected binary path: /usr/bin/uwsgi-core Nov 12 02:25:27.279258 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: your processes number limit is 47680 Nov 12 02:25:27.279258 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: your memory page size is 4096 bytes Nov 12 02:25:27.279258 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: detected max file descriptor number: 2048 Nov 12 02:25:27.279258 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: lock engine: pthread robust mutexes Nov 12 02:25:27.279258 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: thunder lock: enabled Nov 12 02:25:27.279258 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 12 02:25:27.279968 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 12 02:25:27.324395 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: Python main interpreter initialized at 0x5576126c69c0 Nov 12 02:25:27.324395 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: python threads support enabled Nov 12 02:25:27.324395 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: your server socket listen backlog is limited to 100 connections Nov 12 02:25:27.324395 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: your mercy for graceful operations on workers is 90 seconds Nov 12 02:25:27.324842 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: mapped 403077 bytes (393 KB) for 2 cores Nov 12 02:25:27.324842 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: *** Operational MODE: preforking *** Nov 12 02:25:27.325124 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: *** uWSGI is running in multiple interpreter mode *** Nov 12 02:25:27.325124 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: spawned uWSGI master process (pid: 116089) Nov 12 02:25:27.325326 dv-cinder-808574-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 12 02:25:27.326124 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: spawned uWSGI worker 1 (pid: 116098, cores: 1) Nov 12 02:25:27.326640 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: spawned uWSGI worker 2 (pid: 116099, cores: 1) Nov 12 02:25:27.326926 dv-cinder-808574-4-iscsi devstack@n-api.service[116089]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 12 02:25:29.151770 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 12 02:25:29.151770 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: from cryptography.utils import int_from_bytes Nov 12 02:25:29.152490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 12 02:25:29.152490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: from cryptography.utils import int_from_bytes Nov 12 02:25:29.152966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 12 02:25:29.152966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: from cryptography.utils import int_from_bytes Nov 12 02:25:29.153120 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 12 02:25:29.153120 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: from cryptography.utils import int_from_bytes Nov 12 02:25:31.483424 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 12 02:25:31.484061 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 12 02:25:31.484155 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 12 02:25:31.484466 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 12 02:25:31.484757 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 12 02:25:31.485138 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.485475 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.485805 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.486135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.486474 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.486818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.487151 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.487484 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.487821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.488089 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.488413 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.488748 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-808574-4-iscsi {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.489077 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.489394 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.489713 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.490039 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.490386 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.490685 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.491013 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.491520 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.493900 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.494225 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.494575 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.494960 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.495281 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.495607 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.495942 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.496265 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.496604 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.496927 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.497346 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-808574-4-iscsi {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.497698 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.498026 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.498353 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.498790 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.499114 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.499240 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 12 02:25:31.499685 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.499762 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 12 02:25:31.499834 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.500063 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 12 02:25:31.500181 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.500373 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 12 02:25:31.500478 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.500551 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 12 02:25:31.500713 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.500964 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.501073 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.501312 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.501427 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.501629 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.501728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.501964 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.502064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.502272 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.502377 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.502608 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.502746 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.502960 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.503080 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.503292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.503403 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.503618 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.503726 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.503876 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.504029 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.504215 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.504390 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.504544 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.504695 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-808574-4-iscsi {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.504848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.505022 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.505165 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.505405 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.505405 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.505717 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.505876 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.506030 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.506172 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.506314 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.506454 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.506595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.506868 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.507020 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.507169 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.507169 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.507458 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.507630 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.507869 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.508609 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.508845 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.508999 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.509151 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.509307 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.509457 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.509606 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.509767 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.509910 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.510062 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.510213 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.510355 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.510502 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.510643 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.510836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.510986 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.511137 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.511284 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.511433 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.511582 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-808574-4-iscsi {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.511745 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.511900 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.512043 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.512183 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.512323 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.512474 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.512646 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.512799 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.512948 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.513089 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.514688 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.514863 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.515019 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.515184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.515336 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.515487 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.515636 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.515788 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.515946 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.516089 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.516230 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.516370 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.516511 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.516657 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.516811 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.516976 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.517128 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.517277 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.517418 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.517572 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.517714 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.517860 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.518008 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.518156 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.518306 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.518460 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.518609 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.518799 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.518961 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.519109 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.519251 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.519404 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.519553 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.519693 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.519840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.519979 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.520127 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.520280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.520436 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.520585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.520738 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.520888 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.521049 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.521199 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.521342 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.521482 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.521633 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.521786 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.521935 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.522082 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.522222 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.522362 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.522520 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.522710 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.522866 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.523017 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.523158 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.523304 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.523503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.523746 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.523917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.524897 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.525109 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.525255 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.525435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.525676 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.525904 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.526146 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.526388 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.526624 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.526877 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.527106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.527317 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.527317 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.527644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.527876 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.527876 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.528303 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.528557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.528557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.529018 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.529232 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.529232 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.529699 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.529935 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.530152 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.530311 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.530462 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.530604 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.530604 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.530604 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.531068 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.531217 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.531358 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.531499 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.531697 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.531957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.531957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.531957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.531957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.531957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.531957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.531957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.533478 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.533709 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.533951 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.535703 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.535972 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.536230 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.536230 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.536230 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.536230 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.537156 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.537412 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.537657 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.537657 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.538131 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.538371 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.538620 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.538934 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.539183 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.539436 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.539677 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.539913 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.540161 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.540419 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.540667 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.540901 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.541135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.541386 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.541640 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.541875 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.542105 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.542358 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.542605 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.542969 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.543232 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.543461 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.543707 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.543952 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.544199 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.544653 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.546136 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.546392 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.546645 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.546929 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.547170 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.547420 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.547687 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.547927 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.548176 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.548421 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.548663 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.548905 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.549144 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.549377 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.549551 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.549705 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.549848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.550004 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.550154 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.550304 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.550455 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.550597 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.550807 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.550960 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.551117 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.551272 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.551426 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.551576 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.551725 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.551876 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.552017 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.552157 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.552310 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.552451 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.552602 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.552754 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.552896 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.553044 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.553209 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.553402 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.553597 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.553764 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.553908 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.554098 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.554241 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.554380 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.554520 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.555528 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.555933 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.556270 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.556446 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.556591 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.556732 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.556878 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.557021 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.557161 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.557309 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.557309 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.557586 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.557733 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.557883 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.558035 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.558177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.558328 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.558468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.558609 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.558772 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.558925 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.559074 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.559216 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.559355 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.559503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.559643 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.559864 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.559864 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.560136 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 12 02:25:31.560295 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.560438 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.560586 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.560740 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.560882 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.561022 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.561163 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.561302 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.561534 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.561690 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.561834 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.561980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.562131 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.562280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.562434 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.562583 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.562764 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.562924 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.563065 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.563212 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.563363 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.563510 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.563651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.563789 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.563929 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.564078 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.564231 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.564381 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.564536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.564689 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.564831 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.564985 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.565126 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.565289 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.565709 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.566093 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.566417 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.566576 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.566762 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.566907 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.567056 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.567205 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.567356 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.567579 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.567723 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.567872 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.568013 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.568161 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.568309 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.568460 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.568611 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.568770 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.568920 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.569025 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.569183 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.569334 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.569481 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.569481 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.569751 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.569891 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.570043 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.570193 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.570407 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.571158 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.571380 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.571527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.571684 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.571834 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.571975 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.572115 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.572255 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.572255 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.572540 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.572540 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.572817 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.572960 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.573113 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.573263 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.573405 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.573553 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.573702 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.573851 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.573999 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.573999 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.574276 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.574416 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.574564 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.574759 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.574906 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.575069 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.575213 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.575360 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.575519 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.576357 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.576830 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.577088 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.577316 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.577542 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.577768 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.578006 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.578193 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.578349 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.578505 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.578655 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.578823 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.578965 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.579131 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.579274 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.579423 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.579564 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.579711 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.579858 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.580008 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.580157 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.580311 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.580460 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.580602 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.580748 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.580904 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.580904 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.581182 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.581182 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.581182 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.581583 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.581766 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.581911 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.582052 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.582204 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.582360 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.582545 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.582718 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.582876 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.583028 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.583169 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.583310 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.583459 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.583601 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.583748 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.583896 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.583896 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.584215 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.584386 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.584551 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.584794 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.584945 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.585125 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.585402 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.585584 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.585753 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.586217 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.586875 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.587048 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.587214 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.587495 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.587665 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.587816 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.587965 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.588121 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.588280 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.588431 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.588579 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.588777 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.588932 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.589080 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.589239 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.589399 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.589558 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.589716 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.589895 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.590125 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.590298 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.590450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.590600 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.590771 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.590932 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.591090 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.591248 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.591498 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.591666 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.591822 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.591980 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.592138 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.592287 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.592924 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.593077 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.593234 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.593391 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.593551 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.593703 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.593864 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.594019 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.594188 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.594338 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.594502 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.594715 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.594873 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.595022 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.595181 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.595343 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.595493 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.595641 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.595790 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.595938 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.596415 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.596936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.597190 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.597357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.597515 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.597665 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.597814 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.597974 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.598124 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.598272 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.598420 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.598567 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.598744 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.598908 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.599070 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.599227 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.599382 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.599531 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.599693 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.599843 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.599999 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.600156 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.600312 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.600461 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.600695 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.600847 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.601016 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.601173 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.601333 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.601515 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.601765 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.602000 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.602170 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.602327 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.602484 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.602633 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.602819 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.602971 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.603119 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.603280 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.603435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.603435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.603435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.603873 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.604028 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.604192 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.604341 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.604510 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.604669 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.604826 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.604974 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.605122 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.605280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.605280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.605581 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.605731 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.605879 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.606034 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.606208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.607099 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.607379 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.607537 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.607687 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.607836 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.608003 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.608166 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.608315 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.608464 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.608613 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.608767 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.608925 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.609075 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.609223 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.609378 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.609528 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.609675 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.609838 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.610005 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.610163 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.610312 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.610469 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.610618 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.610805 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.610963 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.611120 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.611268 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.611416 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.611573 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.611725 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.611879 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.612037 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.612186 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.612340 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.612497 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.612654 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.612803 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.612957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.613105 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.613261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.613410 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.613565 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.613714 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.613880 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.614166 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.614336 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.614493 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.614655 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.615548 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.615718 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.615877 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.616027 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.616175 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.616323 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.616767 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.616957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.618247 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.618414 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.618564 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.618741 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.618906 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.619070 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.619222 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.619370 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.619525 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.619673 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.619830 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.619989 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.620139 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.620305 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.620454 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.620609 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.620772 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.620930 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.621086 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.621240 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.621389 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.621545 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.622608 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.622818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.623012 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.623179 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.623352 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.623503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.623660 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.623809 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.623965 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.624128 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.624278 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.624426 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.624581 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.624737 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.624886 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.625053 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.625223 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.625381 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.625531 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.625678 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.625678 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.625980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.626130 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.626285 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.626434 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.626434 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.627117 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.627284 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.627554 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.627722 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.627872 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.628392 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.628560 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.628718 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.628868 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.629023 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.629172 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.629322 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.629479 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.629636 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.629792 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.629947 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.630115 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.630264 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.630426 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.630576 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.630772 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.630926 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.631074 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.631220 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.631385 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.631544 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.631700 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.631849 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.632005 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.632173 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.632323 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.632479 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.632634 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.632839 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.633511 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.633749 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.634149 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.634314 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.634473 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.634631 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.634806 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.634992 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.635146 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.635464 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.635635 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.635823 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.636057 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.636152 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.636233 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.636319 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.636418 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.636567 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.636567 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.636802 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.637179 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.637287 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.637928 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.638063 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.638771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.638918 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.639057 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.639148 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.639243 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.639338 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.639425 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.639508 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.639592 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.639685 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.639780 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.639865 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.639949 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.640039 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.640125 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.640217 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.640303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.640386 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.640470 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.640556 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.640647 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.640741 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.640827 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.640921 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.641014 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.641107 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.641199 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.641297 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.641384 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.641468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.641557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.641643 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.641735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.641819 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.641910 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.641996 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.642089 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.642175 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.642268 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.642353 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.642437 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.642527 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.642612 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.642723 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.642825 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.642918 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.643004 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.643087 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.643171 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.643261 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.643384 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.643479 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.643565 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.643648 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.643739 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.643825 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.643922 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.644009 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.644101 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.644187 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.644278 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.644370 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.644455 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.644538 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.644628 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.644713 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.644803 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.644896 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.644985 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.645070 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.645152 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.645242 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.645335 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.645429 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.645523 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.645608 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.645698 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.645790 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.645874 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.645966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.646059 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.646144 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.646227 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.646317 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.646410 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.646496 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.646587 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.646721 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.646821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.646914 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.647009 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.647314 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.647424 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.647512 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.647595 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.647678 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.647786 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.647880 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.647974 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.648066 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.648151 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.648243 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.648336 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.648701 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.648701 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.648890 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.648984 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.649078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.649172 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.649258 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.649341 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.649431 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.649516 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.649612 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.649699 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.649788 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.649947 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.650042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.650127 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.650220 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.650313 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.650399 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.650483 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.650565 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.650649 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.650827 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.650925 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.650925 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.651079 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.651163 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.651255 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.651347 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.651432 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.651432 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.651593 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.651677 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.651768 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.651860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.651953 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.652044 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.652135 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.652220 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.652313 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.652399 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.652482 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.652572 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.652656 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.652747 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.652890 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.653060 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.653149 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.653149 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.653313 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.653469 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.653557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.653640 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.653747 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.653875 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.653962 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.654048 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.654135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.654219 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.654302 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.654392 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.654392 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.654392 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.654392 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.654771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.654848 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.654926 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.655004 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.655004 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.655143 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.655226 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.655316 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.655401 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.655493 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.655585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.655669 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.655752 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.655842 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.655932 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.656095 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.656190 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.656282 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.656374 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.656466 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.656552 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.656645 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.656737 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.656822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.656906 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.656989 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.657079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.657173 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.657489 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.657592 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.657678 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.657762 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.657856 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.657856 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.658066 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.658203 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.658323 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.658435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.658555 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.659426 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.659564 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.660302 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.660435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.660435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.660655 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.660777 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.660889 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.660999 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.661194 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.661308 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.661430 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.661541 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.661659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.661771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.661881 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.661999 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.662119 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.662230 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.662340 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.662457 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.662568 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.662823 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.662956 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.663070 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.663180 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.663297 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.663418 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.663539 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.663657 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.663775 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.663885 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.664001 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.664152 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.664274 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.664386 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.664495 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.664604 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.664721 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.664845 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.664972 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.665089 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.665297 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.665399 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.665492 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.665635 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.665817 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.665913 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.666013 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.666113 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.666207 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.666207 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.666483 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.666586 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.666696 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.666696 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.666971 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.666971 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.667193 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.667306 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.667424 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.667739 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.667878 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.667967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.668052 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.668250 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.668408 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.668518 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.668606 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.668691 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.668775 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.668874 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.669010 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.669261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.669386 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.669724 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.669905 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.670093 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.670201 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.670417 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.670526 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.670614 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.670782 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.670873 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.671047 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.671144 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.671231 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.671316 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.671470 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.671617 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.671743 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.671833 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.671917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.672000 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.672091 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.672185 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.672279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.672371 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.672457 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.672546 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.672631 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.672728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.672728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.672891 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.672891 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.673045 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.673129 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.673224 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.673388 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.673476 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.673567 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.673652 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.673742 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.673839 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.673926 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.674010 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.674092 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.674176 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.674268 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.674354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.674438 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.674521 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.674604 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.674604 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.674789 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.674876 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.675010 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.675010 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.675010 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.675298 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.675397 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.675484 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.675567 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.675567 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.675567 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.675822 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.675957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.676077 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.676170 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.676255 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.676338 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.676436 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.676523 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.676615 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.676706 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.676791 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.676875 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.676967 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.677059 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.677150 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.677236 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.677319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.677410 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.677504 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.677589 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.677853 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.677959 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.678046 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.678139 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.678234 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.678321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.678405 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.678489 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.678572 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.678693 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.678781 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.678854 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.678949 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.679043 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.679136 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.679249 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.679391 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.679488 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.679573 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.680179 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.680259 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.680345 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.680419 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.680489 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.680574 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.680664 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.680763 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.680850 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.680941 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.681158 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.681252 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.681536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.681679 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.681850 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.681946 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.682091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.682192 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.682408 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.682510 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.682780 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.682891 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.683104 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.683196 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.683415 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.683514 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.683725 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.683816 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.684047 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.684140 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.684357 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.684449 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.684671 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.684770 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.684986 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.685123 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.685326 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.685435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.685645 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.685745 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.685960 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.686067 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.686281 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.686381 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.686612 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.686826 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.686977 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.687147 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.687342 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.687487 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.687620 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.687957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.688066 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.688168 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.688256 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.688453 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.688547 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.688780 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.688920 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.689112 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.689211 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.689425 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.689517 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.689735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.689841 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.690051 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.690151 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.690362 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.690500 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.690696 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.690805 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.691020 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.691202 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.691348 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.691595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.691698 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.691941 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.692062 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.692264 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.692452 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.692575 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.692806 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.692934 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.693171 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.693290 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.693495 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.693619 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.693811 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.693939 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.694130 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.694250 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.694447 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.694573 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.694788 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.694909 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.695120 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.695237 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.695486 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.696132 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.696349 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.696488 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.696756 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.697073 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.697384 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.697695 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.697827 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.698091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.698208 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.698322 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.698494 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.698632 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.698855 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.698971 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.699189 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.699284 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.699569 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.699739 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.699898 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.699991 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.700210 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.700311 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.700617 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.700764 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.700881 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.700999 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.701132 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.701228 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.701439 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.701534 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.701748 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.701848 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.702054 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.702148 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.702369 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.702519 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.702692 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.702844 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.703034 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.703358 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.703681 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.703952 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.704070 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.704291 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.704393 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.704624 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.704788 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.704952 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.705044 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.705270 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.705361 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.705585 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.705684 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.705923 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.706125 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.706241 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.706450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.706544 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.706817 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.706915 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.707153 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.707246 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.707486 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.707582 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.707811 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.707912 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.708204 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.708318 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.708484 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.708592 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.708765 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.708861 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.709079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.709336 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.709438 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.709699 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.709791 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.710012 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.710114 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.710343 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.710437 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.710681 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.710826 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.711022 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.711125 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.711351 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.711445 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.711673 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.711772 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.712014 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.712210 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.712312 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.712572 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.712666 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.712898 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.712991 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.713231 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.713338 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.713563 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.713665 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.713866 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.713970 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.714218 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.714362 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.714485 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.714591 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.714829 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.714937 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.715144 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.715238 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.715468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.715569 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.715785 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.715886 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.716096 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.716190 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.716416 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.716583 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.716721 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.716828 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.717035 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.717127 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.717346 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.717447 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.717657 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.717762 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.717966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.718065 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.718386 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.718496 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.718604 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.718731 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.718939 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.719035 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.719263 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.719534 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.719663 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.719796 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.719898 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.719985 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.720177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.720292 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.720489 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.720590 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.720799 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.720919 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.721117 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.721246 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.721487 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.721610 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.721738 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.721875 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.722049 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.722190 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.722366 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.722523 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.722725 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.722893 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.723019 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.723227 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.723329 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.723557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.723651 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.723869 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.723970 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.724180 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.724274 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.724491 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.724609 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.724812 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.724978 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.725151 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.725249 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.725466 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.725563 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.725784 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.725904 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.726102 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.726220 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.726441 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.726639 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.726840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.727034 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.727157 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.727421 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.727541 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.727748 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.727868 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.728079 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.728206 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.728584 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.728717 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.728830 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.728954 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.729075 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.729196 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.729340 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.729467 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.729659 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.729786 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.729977 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.730098 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.730289 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.730413 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.730604 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.730802 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.730948 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.731068 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.731268 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.731387 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.731581 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.731718 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.731892 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.732011 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.732206 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.732333 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.732523 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.732656 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.732839 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.732965 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.733173 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.733307 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.733541 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.733649 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.733815 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.733955 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.734129 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.734224 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.734439 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.734540 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.734790 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.734934 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.735094 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.735195 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.735409 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.735572 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.735730 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.735834 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.736065 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.736169 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.736382 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.736476 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.736693 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.736792 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.737044 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.737221 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.737411 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.737503 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.737727 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.737873 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.738049 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.738187 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.738363 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.738486 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.738840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.738943 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.739020 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 12 02:25:31.739106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.739333 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.739660 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.739975 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.740309 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.740674 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.740982 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.741317 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.741631 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.741943 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.743161 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.743372 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.743713 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.744032 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.744365 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.744682 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.745011 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.745324 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.745652 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.745979 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.746304 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.746621 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.746983 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.747301 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.747963 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.747963 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.748332 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.748562 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.748883 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.749217 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.749550 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.749863 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.750194 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.750518 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.750875 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.751198 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.751517 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.751852 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.752172 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.752493 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.752809 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.753140 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.753448 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.753765 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.754098 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.754428 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.754787 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.755122 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.755477 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.755796 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.756151 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.756484 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.756803 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.757121 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.757530 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 12 02:25:31.757801 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 12 02:25:31.764066 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_db.sqlalchemy.engines [None req-5d37b169-e664-4fff-8dc0-2c85c6df3be5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:25:31.780871 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_db.sqlalchemy.engines [None req-a1fac2ff-6baf-47c4-99e9-4b0eddc6d8bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:25:31.927220 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.context [None req-5d37b169-e664-4fff-8dc0-2c85c6df3be5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6(cell1) {{(pid=116099) load_cells /opt/stack/nova/nova/context.py:464}} Nov 12 02:25:31.932348 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d37b169-e664-4fff-8dc0-2c85c6df3be5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:25:31.933971 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d37b169-e664-4fff-8dc0-2c85c6df3be5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:25:31.934866 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d37b169-e664-4fff-8dc0-2c85c6df3be5 None None] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:25:31.940155 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d37b169-e664-4fff-8dc0-2c85c6df3be5 None None] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:25:31.947475 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.context [None req-a1fac2ff-6baf-47c4-99e9-4b0eddc6d8bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6(cell1) {{(pid=116098) load_cells /opt/stack/nova/nova/context.py:464}} Nov 12 02:25:31.947894 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_db.sqlalchemy.engines [None req-5d37b169-e664-4fff-8dc0-2c85c6df3be5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:25:31.952346 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1fac2ff-6baf-47c4-99e9-4b0eddc6d8bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:25:31.954538 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1fac2ff-6baf-47c4-99e9-4b0eddc6d8bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:25:31.955527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_db.sqlalchemy.engines [None req-5d37b169-e664-4fff-8dc0-2c85c6df3be5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:25:31.955700 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1fac2ff-6baf-47c4-99e9-4b0eddc6d8bb None None] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:25:31.957898 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1fac2ff-6baf-47c4-99e9-4b0eddc6d8bb None None] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:25:31.969367 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_db.sqlalchemy.engines [None req-a1fac2ff-6baf-47c4-99e9-4b0eddc6d8bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:25:31.971828 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_db.sqlalchemy.engines [None req-a1fac2ff-6baf-47c4-99e9-4b0eddc6d8bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:25:32.116848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_db.sqlalchemy.engines [None req-5d37b169-e664-4fff-8dc0-2c85c6df3be5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:25:32.134836 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_db.sqlalchemy.engines [None req-a1fac2ff-6baf-47c4-99e9-4b0eddc6d8bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 12 02:25:32.442356 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: WARNING keystonemiddleware.auth_token [None req-5d37b169-e664-4fff-8dc0-2c85c6df3be5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 12 02:25:32.449163 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: WARNING keystonemiddleware.auth_token [None req-5d37b169-e664-4fff-8dc0-2c85c6df3be5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 12 02:25:32.458328 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: WARNING keystonemiddleware.auth_token [None req-a1fac2ff-6baf-47c4-99e9-4b0eddc6d8bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 12 02:25:32.465589 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: WARNING keystonemiddleware.auth_token [None req-a1fac2ff-6baf-47c4-99e9-4b0eddc6d8bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 12 02:25:32.680408 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: WARNING keystonemiddleware.auth_token [None req-5d37b169-e664-4fff-8dc0-2c85c6df3be5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 12 02:25:32.686215 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: WARNING keystonemiddleware.auth_token [None req-5d37b169-e664-4fff-8dc0-2c85c6df3be5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 12 02:25:32.692819 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5576126c69c0 pid: 116099 (default app) Nov 12 02:25:32.696735 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: WARNING keystonemiddleware.auth_token [None req-a1fac2ff-6baf-47c4-99e9-4b0eddc6d8bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 12 02:25:32.701968 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: WARNING keystonemiddleware.auth_token [None req-a1fac2ff-6baf-47c4-99e9-4b0eddc6d8bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 12 02:25:32.707325 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5576126c69c0 pid: 116098 (default app) Nov 12 02:26:08.363301 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-675e7450-83b4-41e9-8e8c-63dab9e91efc tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Action: 'create', calling method: .version_select at 0x7fc06659bca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1452478609"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:09.830064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-675e7450-83b4-41e9-8e8c-63dab9e91efc tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.852217 Nov 12 02:26:09.832212 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 1/1] 10.222.0.70 () {60 vars in 1154 bytes} [Fri Nov 12 02:26:06 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2856 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 12 02:26:10.426341 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-45d9e880-7260-4142-9faa-f170972179a7 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc0665e4940>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:10.819377 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1139220107", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "networks": [{"uuid": "4070c229-4da3-4ab6-91a8-6b9e74d5d318"}]}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:11.059491 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.network.neutron [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] validate_networks() for [('4070c229-4da3-4ab6-91a8-6b9e74d5d318', None, None, None, None, None)] {{(pid=116099) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:26:11.072214 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-45d9e880-7260-4142-9faa-f170972179a7 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d" status: 200 len: 345 microversion: 2.1 time: 1.229167 Nov 12 02:26:11.073196 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 1/2] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:26:09 2021] GET /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d => generated 345 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:11.189818 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-957837239", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "networks": [{"uuid": "95991a5c-ee47-43e2-ab98-8e43221b404f"}]}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:11.409732 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] validate_networks() for [('95991a5c-ee47-43e2-ab98-8e43221b404f', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:26:13.325323 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Flavor limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:26:13.326699 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Image limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:26:13.327464 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Flavor pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:26:13.328068 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Image pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:26:13.328658 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:26:13.364780 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:13.365632 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:13.368628 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:13.369367 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:13.413926 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Getting quotas for project bf1009072a7446b8a468d02d87b9420d. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:26:13.424298 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Getting quotas for user 8f90ce43dddc437fbd6d0531529c6456 and project bf1009072a7446b8a468d02d87b9420d. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:26:13.442609 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Going to run 1 instances... {{(pid=116099) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:26:13.448450 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:26:13.645825 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b5676168-fcd9-40dc-b507-7c46c45e11dc tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.969933 Nov 12 02:26:13.646529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 2/3] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:26:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 2972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:26:13.663963 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a2090232-3dc7-4462-81fc-2f53ec2c9195 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc06638f0d0>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:13.671575 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:26:13.673314 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:26:13.674199 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:26:13.676151 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:26:13.677434 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:26:13.781379 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:13.782525 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:13.784445 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:13.785450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:13.870421 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a2090232-3dc7-4462-81fc-2f53ec2c9195 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d" status: 200 len: 346 microversion: 2.1 time: 0.222415 Nov 12 02:26:13.872110 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 3/4] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:26:13 2021] GET /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d => generated 346 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:13.890552 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7c395f04-3e98-4c07-9086-cf67cc5ddbf6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:13.894043 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7c395f04-3e98-4c07-9086-cf67cc5ddbf6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:14.003118 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Getting quotas for project 913792060b1047f18c5dad6b397f1791. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:26:14.017178 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Getting quotas for user f4448dae2a5949de870daa9501bfaa17 and project 913792060b1047f18c5dad6b397f1791. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:26:14.056915 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:26:14.064321 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:26:14.128858 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7c395f04-3e98-4c07-9086-cf67cc5ddbf6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:14.181082 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7c395f04-3e98-4c07-9086-cf67cc5ddbf6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1218 microversion: 2.1 time: 0.307267 Nov 12 02:26:14.181683 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 4/5] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:13 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1218 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:14.196142 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-22663a5a-cd67-4f96-9a28-36ac685000ef tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Action: 'create', calling method: .version_select at 0x7fc065323c10>, body: {"snapshot": {"volume_id": "5d4f1e6c-1893-4486-bce5-5a8083ee6c9d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-42953583"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:14.377145 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b3a53b34-6bf2-4583-8f55-b1c980820d76 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.302388 Nov 12 02:26:14.377828 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 2/6] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:26:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 3304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:26:14.389785 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b6b9e65a-ef34-4425-85ac-20e3f31f6417 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:14.390406 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b6b9e65a-ef34-4425-85ac-20e3f31f6417 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:14.586096 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-22663a5a-cd67-4f96-9a28-36ac685000ef tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.401267 Nov 12 02:26:14.587683 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 5/7] 10.222.0.70 () {60 vars in 1161 bytes} [Fri Nov 12 02:26:14 2021] POST /compute/v2.1/os-snapshots => generated 285 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:14.608303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c3ccfe88-fcae-4359-ae3b-d5520377c003 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc065335af0>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:14.691249 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b6b9e65a-ef34-4425-85ac-20e3f31f6417 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:14.731963 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b6b9e65a-ef34-4425-85ac-20e3f31f6417 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1214 microversion: 2.1 time: 0.346959 Nov 12 02:26:14.736237 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 3/8] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:14 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1214 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:14.762163 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c3ccfe88-fcae-4359-ae3b-d5520377c003 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11" status: 200 len: 285 microversion: 2.1 time: 0.168178 Nov 12 02:26:14.762933 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 6/9] 10.222.0.70 () {58 vars in 1250 bytes} [Fri Nov 12 02:26:14 2021] GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:14.773501 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-032c3d2e-67dd-4615-a421-1e367e6529b4 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc06531bd30>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:14.862100 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-032c3d2e-67dd-4615-a421-1e367e6529b4 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.092045 Nov 12 02:26:14.863055 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 4/10] 10.222.0.70 () {58 vars in 1139 bytes} [Fri Nov 12 02:26:14 2021] GET /compute/v2.1/os-snapshots => generated 288 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:14.874781 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9128d4d7-6061-444f-957b-ab1b2598a74f tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc066e07430>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:14.941773 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9128d4d7-6061-444f-957b-ab1b2598a74f tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11" status: 200 len: 285 microversion: 2.1 time: 0.071242 Nov 12 02:26:14.942347 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 7/11] 10.222.0.70 () {58 vars in 1250 bytes} [Fri Nov 12 02:26:14 2021] GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11 => generated 285 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:15.198875 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-28833ba1-0a0d-41d3-8a2d-53b994db08d3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:15.199820 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-28833ba1-0a0d-41d3-8a2d-53b994db08d3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:15.334490 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-28833ba1-0a0d-41d3-8a2d-53b994db08d3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:15.341252 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-28833ba1-0a0d-41d3-8a2d-53b994db08d3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1218 microversion: 2.1 time: 0.146772 Nov 12 02:26:15.352772 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 5/12] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:15 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:15.752700 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6bbac431-6351-437b-9295-f4d257656af5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:15.754152 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6bbac431-6351-437b-9295-f4d257656af5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:15.956595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-688cdcd8-3a5e-4d33-b2e9-384054d25d1a tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc0653370d0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:15.989099 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6bbac431-6351-437b-9295-f4d257656af5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:15.997794 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6bbac431-6351-437b-9295-f4d257656af5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1214 microversion: 2.1 time: 0.249718 Nov 12 02:26:15.999781 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 8/13] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:15 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1214 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:16.040187 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-688cdcd8-3a5e-4d33-b2e9-384054d25d1a tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11" status: 200 len: 285 microversion: 2.1 time: 0.090089 Nov 12 02:26:16.041170 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 6/14] 10.222.0.70 () {58 vars in 1250 bytes} [Fri Nov 12 02:26:15 2021] GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11 => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:26:16.359285 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-79565428-5125-4771-b917-821f1b04bda6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:16.360145 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-79565428-5125-4771-b917-821f1b04bda6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:16.373053 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-79565428-5125-4771-b917-821f1b04bda6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:16.373830 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-79565428-5125-4771-b917-821f1b04bda6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:16.374827 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-79565428-5125-4771-b917-821f1b04bda6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:16.375445 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-79565428-5125-4771-b917-821f1b04bda6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:16.761695 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-79565428-5125-4771-b917-821f1b04bda6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:16.790967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-79565428-5125-4771-b917-821f1b04bda6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1222 microversion: 2.1 time: 0.435388 Nov 12 02:26:16.796651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 9/15] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:16 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1222 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:17.013990 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6f4df56c-a695-40cb-a929-db849934e26f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:17.014604 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6f4df56c-a695-40cb-a929-db849934e26f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:17.024996 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f4df56c-a695-40cb-a929-db849934e26f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:17.025467 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f4df56c-a695-40cb-a929-db849934e26f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:17.026279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f4df56c-a695-40cb-a929-db849934e26f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:17.026743 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f4df56c-a695-40cb-a929-db849934e26f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:17.053062 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7bc0fb04-2a71-47a6-b608-763e0277941b tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc065348160>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:17.104198 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7bc0fb04-2a71-47a6-b608-763e0277941b tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11" status: 200 len: 285 microversion: 2.1 time: 0.055588 Nov 12 02:26:17.105068 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 10/16] 10.222.0.70 () {58 vars in 1250 bytes} [Fri Nov 12 02:26:17 2021] GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11 => generated 285 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:17.528078 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6f4df56c-a695-40cb-a929-db849934e26f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:17.550270 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6f4df56c-a695-40cb-a929-db849934e26f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1218 microversion: 2.1 time: 0.538671 Nov 12 02:26:17.552133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 7/17] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:17 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1218 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:17.808162 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c2ab13c7-ca0c-4b7e-be9a-58e1ed9a8f14 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:17.808771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c2ab13c7-ca0c-4b7e-be9a-58e1ed9a8f14 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:17.824724 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c2ab13c7-ca0c-4b7e-be9a-58e1ed9a8f14 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:17.825594 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c2ab13c7-ca0c-4b7e-be9a-58e1ed9a8f14 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:17.826588 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c2ab13c7-ca0c-4b7e-be9a-58e1ed9a8f14 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:17.827252 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c2ab13c7-ca0c-4b7e-be9a-58e1ed9a8f14 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:17.980354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c2ab13c7-ca0c-4b7e-be9a-58e1ed9a8f14 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:17.988676 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c2ab13c7-ca0c-4b7e-be9a-58e1ed9a8f14 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1222 microversion: 2.1 time: 0.184252 Nov 12 02:26:17.989941 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 11/18] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:17 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1222 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:18.127273 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-69c3b063-74ab-448a-8d38-608894840c9d tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc0652b8af0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:18.219874 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-69c3b063-74ab-448a-8d38-608894840c9d tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11" status: 200 len: 285 microversion: 2.1 time: 0.105815 Nov 12 02:26:18.225020 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 8/19] 10.222.0.70 () {58 vars in 1250 bytes} [Fri Nov 12 02:26:18 2021] GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11 => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:18.578543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-896a684e-be36-4b59-bc6b-86bb3132994b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:18.588219 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-896a684e-be36-4b59-bc6b-86bb3132994b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:18.605735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-896a684e-be36-4b59-bc6b-86bb3132994b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:18.608240 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-896a684e-be36-4b59-bc6b-86bb3132994b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:18.610246 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-896a684e-be36-4b59-bc6b-86bb3132994b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:18.615938 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-896a684e-be36-4b59-bc6b-86bb3132994b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:18.991594 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-896a684e-be36-4b59-bc6b-86bb3132994b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:19.007094 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e81dd66e-69d2-4418-b428-3fbd9ca5a9b6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:19.007309 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e81dd66e-69d2-4418-b428-3fbd9ca5a9b6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:19.007405 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-896a684e-be36-4b59-bc6b-86bb3132994b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1210 microversion: 2.1 time: 0.435857 Nov 12 02:26:19.008521 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 12/20] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:18 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1210 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:19.060881 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e81dd66e-69d2-4418-b428-3fbd9ca5a9b6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:19.061333 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e81dd66e-69d2-4418-b428-3fbd9ca5a9b6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:19.071635 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e81dd66e-69d2-4418-b428-3fbd9ca5a9b6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:19.072298 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e81dd66e-69d2-4418-b428-3fbd9ca5a9b6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:19.231856 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2b7edda6-42bb-44e8-acb5-0f1ce28bd38d tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc065261a60>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:19.298589 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2b7edda6-42bb-44e8-acb5-0f1ce28bd38d tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11" status: 200 len: 285 microversion: 2.1 time: 0.063981 Nov 12 02:26:19.298589 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 13/21] 10.222.0.70 () {58 vars in 1250 bytes} [Fri Nov 12 02:26:19 2021] GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11 => generated 285 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:26:19.306704 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e81dd66e-69d2-4418-b428-3fbd9ca5a9b6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:19.318627 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e81dd66e-69d2-4418-b428-3fbd9ca5a9b6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1270 microversion: 2.1 time: 0.317022 Nov 12 02:26:19.326935 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 9/22] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:19 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1270 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:20.025359 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2dcfff6f-d271-44a8-8ee9-4e83847e4086 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:20.025992 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2dcfff6f-d271-44a8-8ee9-4e83847e4086 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:20.033242 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2dcfff6f-d271-44a8-8ee9-4e83847e4086 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:20.033716 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2dcfff6f-d271-44a8-8ee9-4e83847e4086 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:20.038536 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2dcfff6f-d271-44a8-8ee9-4e83847e4086 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:20.041339 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2dcfff6f-d271-44a8-8ee9-4e83847e4086 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:20.440980 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-15785ae5-aedc-41ca-8b50-320354a4d036 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'create', calling method: .version_select at 0x7fc065274af0>, body: {"keypair": {"name": "tempest-keypair-20366487"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:20.496039 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2dcfff6f-d271-44a8-8ee9-4e83847e4086 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:20.500708 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-15785ae5-aedc-41ca-8b50-320354a4d036 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Getting quotas for project 77e4b228dda14fa7852c7fe639ed28b0. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:26:20.507136 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2dcfff6f-d271-44a8-8ee9-4e83847e4086 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1210 microversion: 2.1 time: 0.483637 Nov 12 02:26:20.518318 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 10/23] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:20 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1210 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:20.519074 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-15785ae5-aedc-41ca-8b50-320354a4d036 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Getting quotas for user 808aadbd72b54806add54c601d755481 and project 77e4b228dda14fa7852c7fe639ed28b0. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:26:20.524435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-02c8faeb-c44d-4705-8306-503f48fe2a70 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc06525c310>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:20.643822 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-02c8faeb-c44d-4705-8306-503f48fe2a70 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11" status: 200 len: 285 microversion: 2.1 time: 0.130133 Nov 12 02:26:20.644392 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 11/24] 10.222.0.70 () {58 vars in 1250 bytes} [Fri Nov 12 02:26:20 2021] GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:20.799825 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4ac1d447-bcdc-4586-8b29-df74611e25f3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'create', calling method: .version_select at 0x7fc065329dc0>, body: {"keypair": {"name": "tempest-keypair-914282284"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:20.907737 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-4ac1d447-bcdc-4586-8b29-df74611e25f3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Getting quotas for project 4e70a88f4b094066abaf2d0cd853f751. Resources: {'key_pairs'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:26:20.924491 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-4ac1d447-bcdc-4586-8b29-df74611e25f3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Getting quotas for user eec0f3e481084226af3e4cb004585024 and project 4e70a88f4b094066abaf2d0cd853f751. Resources: {'key_pairs'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:26:21.144024 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-15785ae5-aedc-41ca-8b50-320354a4d036 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Getting quotas for project 77e4b228dda14fa7852c7fe639ed28b0. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:26:21.156784 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-15785ae5-aedc-41ca-8b50-320354a4d036 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Getting quotas for user 808aadbd72b54806add54c601d755481 and project 77e4b228dda14fa7852c7fe639ed28b0. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:26:21.218567 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-15785ae5-aedc-41ca-8b50-320354a4d036 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 1.242438 Nov 12 02:26:21.219862 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 14/25] 10.222.0.70 () {60 vars in 1157 bytes} [Fri Nov 12 02:26:19 2021] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:21.233602 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f5cf5140-1d63-4a25-b14e-cfcde6f85eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:21.237788 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f5cf5140-1d63-4a25-b14e-cfcde6f85eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:21.253356 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f5cf5140-1d63-4a25-b14e-cfcde6f85eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:21.254882 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f5cf5140-1d63-4a25-b14e-cfcde6f85eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:21.257937 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f5cf5140-1d63-4a25-b14e-cfcde6f85eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:21.258635 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f5cf5140-1d63-4a25-b14e-cfcde6f85eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:21.264363 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-4ac1d447-bcdc-4586-8b29-df74611e25f3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Getting quotas for project 4e70a88f4b094066abaf2d0cd853f751. Resources: {'key_pairs'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:26:21.278348 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-4ac1d447-bcdc-4586-8b29-df74611e25f3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Getting quotas for user eec0f3e481084226af3e4cb004585024 and project 4e70a88f4b094066abaf2d0cd853f751. Resources: {'key_pairs'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:26:21.312919 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4ac1d447-bcdc-4586-8b29-df74611e25f3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.663150 Nov 12 02:26:21.314418 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 12/26] 10.222.0.70 () {62 vars in 1198 bytes} [Fri Nov 12 02:26:20 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 665 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 12 02:26:21.459807 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f5cf5140-1d63-4a25-b14e-cfcde6f85eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:21.473501 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f5cf5140-1d63-4a25-b14e-cfcde6f85eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1270 microversion: 2.1 time: 0.252025 Nov 12 02:26:21.476623 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 15/27] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:21 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1270 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:21.526125 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-873e01d4-daaa-4e09-bee1-adc88c93f927 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:21.526712 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-873e01d4-daaa-4e09-bee1-adc88c93f927 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:21.541560 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-873e01d4-daaa-4e09-bee1-adc88c93f927 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:21.542010 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-873e01d4-daaa-4e09-bee1-adc88c93f927 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:21.549707 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-873e01d4-daaa-4e09-bee1-adc88c93f927 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:21.550277 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-873e01d4-daaa-4e09-bee1-adc88c93f927 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:21.652929 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-850709313", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7bcaccdf-bd76-45bd-9265-ce14bbe635ff"}]}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:21.749405 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-873e01d4-daaa-4e09-bee1-adc88c93f927 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:21.758277 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-873e01d4-daaa-4e09-bee1-adc88c93f927 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1210 microversion: 2.1 time: 0.236448 Nov 12 02:26:21.759534 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 16/28] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:21 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1210 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:21.759944 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] validate_networks() for [('7bcaccdf-bd76-45bd-9265-ce14bbe635ff', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:26:21.776108 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b309aefe-eb33-4e5a-aef6-4bad27fa302b tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc0652bdf70>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:21.829076 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b309aefe-eb33-4e5a-aef6-4bad27fa302b tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11" status: 200 len: 285 microversion: 2.1 time: 0.068445 Nov 12 02:26:21.830144 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 17/29] 10.222.0.70 () {58 vars in 1250 bytes} [Fri Nov 12 02:26:21 2021] GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11 => generated 285 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:22.492563 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5eb1c484-9cdf-4835-adb8-3a2fa5cb0f10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:22.494199 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5eb1c484-9cdf-4835-adb8-3a2fa5cb0f10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:22.505498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5eb1c484-9cdf-4835-adb8-3a2fa5cb0f10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:22.506946 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5eb1c484-9cdf-4835-adb8-3a2fa5cb0f10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:22.508337 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5eb1c484-9cdf-4835-adb8-3a2fa5cb0f10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:22.512229 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5eb1c484-9cdf-4835-adb8-3a2fa5cb0f10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:22.820890 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5eb1c484-9cdf-4835-adb8-3a2fa5cb0f10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:22.834840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5eb1c484-9cdf-4835-adb8-3a2fa5cb0f10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1270 microversion: 2.1 time: 0.346565 Nov 12 02:26:22.836883 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:26:22.837619 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:26:22.838548 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:26:22.839307 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:26:22.840916 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:26:22.843898 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 18/30] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:22 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1270 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:22.848699 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-525f4b23-6f8b-4ad3-bde8-aaf070c1995f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:22.856450 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-525f4b23-6f8b-4ad3-bde8-aaf070c1995f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:22.880328 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-525f4b23-6f8b-4ad3-bde8-aaf070c1995f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:22.881605 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-525f4b23-6f8b-4ad3-bde8-aaf070c1995f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:22.882152 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:22.885133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:22.886330 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-525f4b23-6f8b-4ad3-bde8-aaf070c1995f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:22.886435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:22.887215 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-525f4b23-6f8b-4ad3-bde8-aaf070c1995f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:22.890301 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:22.942012 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Getting quotas for project d7fcf7713f094fac83c523a879fb68ae. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:26:22.953728 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Getting quotas for user 55918cc1c2fa4eb488dcfb2942fb5edc and project d7fcf7713f094fac83c523a879fb68ae. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:26:22.985066 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:26:22.987363 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:26:23.137946 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-16a6f5b3-8954-4e97-a21c-aab572d558fc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.800853 Nov 12 02:26:23.139137 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 13/31] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:26:21 2021] POST /compute/v2.1/servers => generated 383 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:26:23.160718 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-86e169f5-0c70-42e6-a01c-ec5ed8343934 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc065343160>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:23.161019 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-525f4b23-6f8b-4ad3-bde8-aaf070c1995f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:23.173399 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-525f4b23-6f8b-4ad3-bde8-aaf070c1995f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1266 microversion: 2.1 time: 0.328146 Nov 12 02:26:23.187809 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 19/32] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:22 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1266 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:23.202468 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7651c53b-9bc4-458d-871a-76a54cfb8445 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:23.206871 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7651c53b-9bc4-458d-871a-76a54cfb8445 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:23.268155 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-86e169f5-0c70-42e6-a01c-ec5ed8343934 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11" status: 200 len: 286 microversion: 2.1 time: 0.119973 Nov 12 02:26:23.268846 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 14/33] 10.222.0.70 () {58 vars in 1250 bytes} [Fri Nov 12 02:26:23 2021] GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11 => generated 286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:23.280709 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d5a770cb-6aeb-4c70-b178-45a08e49dde0 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc06526fca0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:23.403898 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7651c53b-9bc4-458d-871a-76a54cfb8445 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:23.415953 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7651c53b-9bc4-458d-871a-76a54cfb8445 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1221 microversion: 2.1 time: 0.226511 Nov 12 02:26:23.432467 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 20/34] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:23 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1221 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:23.463295 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d5a770cb-6aeb-4c70-b178-45a08e49dde0 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11" status: 202 len: 0 microversion: 2.1 time: 0.186254 Nov 12 02:26:23.464007 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 15/35] 10.222.0.70 () {58 vars in 1253 bytes} [Fri Nov 12 02:26:23 2021] DELETE /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:26:23.477898 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-222bdc1a-0ada-4fa7-8713-e37bea53cc08 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc0652305e0>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:23.560559 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-222bdc1a-0ada-4fa7-8713-e37bea53cc08 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11" status: 200 len: 285 microversion: 2.1 time: 0.090935 Nov 12 02:26:23.565214 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 21/36] 10.222.0.70 () {58 vars in 1250 bytes} [Fri Nov 12 02:26:23 2021] GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11 => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:23.763972 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-113515508", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7bcaccdf-bd76-45bd-9265-ce14bbe635ff"}]}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:23.875528 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7f94db25-69d2-4cb1-9dc4-e6b2321fc54c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:23.877535 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7f94db25-69d2-4cb1-9dc4-e6b2321fc54c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:23.905112 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7f94db25-69d2-4cb1-9dc4-e6b2321fc54c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:23.905904 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7f94db25-69d2-4cb1-9dc4-e6b2321fc54c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:23.909509 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7f94db25-69d2-4cb1-9dc4-e6b2321fc54c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:23.913475 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7f94db25-69d2-4cb1-9dc4-e6b2321fc54c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:23.928066 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] validate_networks() for [('7bcaccdf-bd76-45bd-9265-ce14bbe635ff', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:26:24.185750 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7f94db25-69d2-4cb1-9dc4-e6b2321fc54c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:24.198767 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7f94db25-69d2-4cb1-9dc4-e6b2321fc54c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1276 microversion: 2.1 time: 0.337136 Nov 12 02:26:24.200236 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 22/37] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:23 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1276 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:24.211868 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-97a91fff-1218-4ac0-a232-3c34d1c4e359 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:24.214587 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-97a91fff-1218-4ac0-a232-3c34d1c4e359 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:24.232689 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-97a91fff-1218-4ac0-a232-3c34d1c4e359 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:24.233461 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-97a91fff-1218-4ac0-a232-3c34d1c4e359 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:24.234478 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-97a91fff-1218-4ac0-a232-3c34d1c4e359 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:24.235171 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-97a91fff-1218-4ac0-a232-3c34d1c4e359 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:24.387679 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-97a91fff-1218-4ac0-a232-3c34d1c4e359 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:24.409354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-97a91fff-1218-4ac0-a232-3c34d1c4e359 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1272 microversion: 2.1 time: 0.207432 Nov 12 02:26:24.411261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 23/38] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:24 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:24.577061 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-11f165c1-081c-4920-8e16-d00a183e7a9a tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc065292b80>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:24.677726 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-11f165c1-081c-4920-8e16-d00a183e7a9a tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] HTTP exception thrown: Snapshot 732a8c2f-2505-4c58-aed6-c80fa25f5a11 could not be found. Nov 12 02:26:24.679278 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-11f165c1-081c-4920-8e16-d00a183e7a9a tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Returning 404 to user: Snapshot 732a8c2f-2505-4c58-aed6-c80fa25f5a11 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:26:24.680247 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-11f165c1-081c-4920-8e16-d00a183e7a9a tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11" status: 404 len: 111 microversion: 2.1 time: 0.109828 Nov 12 02:26:24.680964 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 24/39] 10.222.0.70 () {58 vars in 1250 bytes} [Fri Nov 12 02:26:24 2021] GET /compute/v2.1/os-snapshots/732a8c2f-2505-4c58-aed6-c80fa25f5a11 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:26:24.693778 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-27bb3dea-ba08-44a8-9492-1447f5b98539 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc0652d53a0>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:24.906937 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-27bb3dea-ba08-44a8-9492-1447f5b98539 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d" status: 202 len: 0 microversion: 2.1 time: 0.220853 Nov 12 02:26:24.907867 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 25/40] 10.222.0.70 () {58 vars in 1247 bytes} [Fri Nov 12 02:26:24 2021] DELETE /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:26:24.918345 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-667a76e8-402e-40f6-ad7f-31847217b3c5 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc0652bdee0>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:25.041101 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-667a76e8-402e-40f6-ad7f-31847217b3c5 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d" status: 200 len: 345 microversion: 2.1 time: 0.128545 Nov 12 02:26:25.041684 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 26/41] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:26:24 2021] GET /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d => generated 345 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:26:25.240632 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a507919a-9464-4792-8a8d-4954b26d9e8e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:25.242211 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a507919a-9464-4792-8a8d-4954b26d9e8e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:25.273001 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a507919a-9464-4792-8a8d-4954b26d9e8e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:25.273457 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a507919a-9464-4792-8a8d-4954b26d9e8e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:25.275826 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a507919a-9464-4792-8a8d-4954b26d9e8e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:25.276269 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a507919a-9464-4792-8a8d-4954b26d9e8e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:25.783241 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a507919a-9464-4792-8a8d-4954b26d9e8e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:25.792201 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a507919a-9464-4792-8a8d-4954b26d9e8e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1276 microversion: 2.1 time: 0.577779 Nov 12 02:26:25.813868 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 27/42] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:25 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1276 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:25.834393 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-376bdcb9-4e81-409c-ae61-e2f3c956d550 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:25.835053 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-376bdcb9-4e81-409c-ae61-e2f3c956d550 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:25.861307 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-376bdcb9-4e81-409c-ae61-e2f3c956d550 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:25.861761 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-376bdcb9-4e81-409c-ae61-e2f3c956d550 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:25.862587 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-376bdcb9-4e81-409c-ae61-e2f3c956d550 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:25.863031 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-376bdcb9-4e81-409c-ae61-e2f3c956d550 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:25.974434 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:26:25.975662 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:26:25.975910 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:26:25.976319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:26:25.976740 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:26:25.997272 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:25.998191 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:25.999309 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:25.999929 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:26.070578 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Getting quotas for project d7fcf7713f094fac83c523a879fb68ae. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:26:26.084241 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Getting quotas for user 55918cc1c2fa4eb488dcfb2942fb5edc and project d7fcf7713f094fac83c523a879fb68ae. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:26:26.115529 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:26:26.120579 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:26:26.157065 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-376bdcb9-4e81-409c-ae61-e2f3c956d550 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:26.169311 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-376bdcb9-4e81-409c-ae61-e2f3c956d550 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1272 microversion: 2.1 time: 0.351954 Nov 12 02:26:26.174872 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 28/43] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:25 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1272 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:26.180153 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-565c2646-3fc8-4e68-88e8-c336b48d2628 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc066e074c0>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:26.248634 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-62c2f0b4-a982-4afa-a6fc-b665c556bda5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.491636 Nov 12 02:26:26.249393 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 16/44] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:26:23 2021] POST /compute/v2.1/servers => generated 383 bytes in 2494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:26:26.254609 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-565c2646-3fc8-4e68-88e8-c336b48d2628 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] HTTP exception thrown: Volume 5d4f1e6c-1893-4486-bce5-5a8083ee6c9d could not be found. Nov 12 02:26:26.255267 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-565c2646-3fc8-4e68-88e8-c336b48d2628 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Returning 404 to user: Volume 5d4f1e6c-1893-4486-bce5-5a8083ee6c9d could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:26:26.256114 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-565c2646-3fc8-4e68-88e8-c336b48d2628 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d" status: 404 len: 109 microversion: 2.1 time: 0.080271 Nov 12 02:26:26.257649 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 29/45] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:26:26 2021] GET /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:26:26.270040 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c1600a51-1a1c-48be-9f4f-588b9fbb9d38 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:26.275448 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c1600a51-1a1c-48be-9f4f-588b9fbb9d38 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:26.276319 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-521308ee-2438-4b96-a27e-d33c322d85d0 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc0652928b0>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:26.367993 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-521308ee-2438-4b96-a27e-d33c322d85d0 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] HTTP exception thrown: Volume 5d4f1e6c-1893-4486-bce5-5a8083ee6c9d could not be found. Nov 12 02:26:26.368663 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-521308ee-2438-4b96-a27e-d33c322d85d0 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Returning 404 to user: Volume 5d4f1e6c-1893-4486-bce5-5a8083ee6c9d could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:26:26.369500 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-521308ee-2438-4b96-a27e-d33c322d85d0 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d" status: 404 len: 109 microversion: 2.1 time: 0.106157 Nov 12 02:26:26.370412 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 30/46] 10.222.0.70 () {58 vars in 1247 bytes} [Fri Nov 12 02:26:26 2021] DELETE /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:26:26.377731 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e59fa172-2f87-46ec-8a5a-ae2f7c6edd35 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Calling method '.version_select at 0x7fc065274550>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:26.450204 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-e59fa172-2f87-46ec-8a5a-ae2f7c6edd35 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] HTTP exception thrown: Volume 5d4f1e6c-1893-4486-bce5-5a8083ee6c9d could not be found. Nov 12 02:26:26.451006 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e59fa172-2f87-46ec-8a5a-ae2f7c6edd35 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] Returning 404 to user: Volume 5d4f1e6c-1893-4486-bce5-5a8083ee6c9d could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:26:26.452096 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e59fa172-2f87-46ec-8a5a-ae2f7c6edd35 tempest-VolumesSnapshotsTestJSON-1254917914 tempest-VolumesSnapshotsTestJSON-1254917914-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d" status: 404 len: 109 microversion: 2.1 time: 0.077923 Nov 12 02:26:26.453228 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 31/47] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:26:26 2021] GET /compute/v2.1/os-volumes/5d4f1e6c-1893-4486-bce5-5a8083ee6c9d => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:26:26.532041 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c1600a51-1a1c-48be-9f4f-588b9fbb9d38 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:26.542840 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c1600a51-1a1c-48be-9f4f-588b9fbb9d38 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1221 microversion: 2.1 time: 0.283097 Nov 12 02:26:26.547043 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 17/48] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:26 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1221 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:26.821316 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-07b80700-05e1-49d3-bb9a-d12b663fe1ce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:26.823907 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-07b80700-05e1-49d3-bb9a-d12b663fe1ce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:26.841672 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-07b80700-05e1-49d3-bb9a-d12b663fe1ce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:26.849354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-07b80700-05e1-49d3-bb9a-d12b663fe1ce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:26.855614 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-07b80700-05e1-49d3-bb9a-d12b663fe1ce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:26.856516 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-07b80700-05e1-49d3-bb9a-d12b663fe1ce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:27.188670 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e8420c32-6729-44c7-96cf-717d4ff242f1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:27.190193 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e8420c32-6729-44c7-96cf-717d4ff242f1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:27.208700 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8420c32-6729-44c7-96cf-717d4ff242f1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:27.211862 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8420c32-6729-44c7-96cf-717d4ff242f1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:27.214590 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8420c32-6729-44c7-96cf-717d4ff242f1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:27.217444 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8420c32-6729-44c7-96cf-717d4ff242f1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:27.302321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-07b80700-05e1-49d3-bb9a-d12b663fe1ce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:27.314175 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-07b80700-05e1-49d3-bb9a-d12b663fe1ce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1276 microversion: 2.1 time: 0.496937 Nov 12 02:26:27.317252 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 32/49] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:26 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1276 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:27.371025 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e8420c32-6729-44c7-96cf-717d4ff242f1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:27.389025 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e8420c32-6729-44c7-96cf-717d4ff242f1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1272 microversion: 2.1 time: 0.205194 Nov 12 02:26:27.409239 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 18/50] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:27 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:27.565139 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-65fde7d5-8fff-4f58-8ab4-92a86a293415 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:27.565902 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-65fde7d5-8fff-4f58-8ab4-92a86a293415 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:27.575878 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-65fde7d5-8fff-4f58-8ab4-92a86a293415 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:27.585326 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-65fde7d5-8fff-4f58-8ab4-92a86a293415 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:27.586592 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-65fde7d5-8fff-4f58-8ab4-92a86a293415 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:27.588822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-65fde7d5-8fff-4f58-8ab4-92a86a293415 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:27.724267 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-65fde7d5-8fff-4f58-8ab4-92a86a293415 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:27.733930 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-65fde7d5-8fff-4f58-8ab4-92a86a293415 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1225 microversion: 2.1 time: 0.172965 Nov 12 02:26:27.739303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 33/51] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:27 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1225 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:28.041619 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2021718939", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed2ba848-d313-464e-93cb-db87f28d8bf9"}], "security_groups": [{"name": "tempest-securitygroup--2067388527"}], "key_name": "tempest-keypair-914282284", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:28.334752 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0c93e4ee-690a-498a-b925-1c3f2bea76f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:28.335724 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0c93e4ee-690a-498a-b925-1c3f2bea76f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:28.378398 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0c93e4ee-690a-498a-b925-1c3f2bea76f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:28.380510 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0c93e4ee-690a-498a-b925-1c3f2bea76f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:28.383208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0c93e4ee-690a-498a-b925-1c3f2bea76f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:28.394168 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0c93e4ee-690a-498a-b925-1c3f2bea76f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:28.720536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0c93e4ee-690a-498a-b925-1c3f2bea76f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:28.730644 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0c93e4ee-690a-498a-b925-1c3f2bea76f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1276 microversion: 2.1 time: 0.399414 Nov 12 02:26:28.749837 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 34/52] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:28 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1276 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:28.755183 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] validate_networks() for [('ed2ba848-d313-464e-93cb-db87f28d8bf9', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:26:28.759160 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c05b85d8-610d-421d-b549-b96f83a6b1cf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:28.761994 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c05b85d8-610d-421d-b549-b96f83a6b1cf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:28.797630 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c05b85d8-610d-421d-b549-b96f83a6b1cf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:28.799109 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c05b85d8-610d-421d-b549-b96f83a6b1cf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:28.807499 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c05b85d8-610d-421d-b549-b96f83a6b1cf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:28.812111 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c05b85d8-610d-421d-b549-b96f83a6b1cf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:29.264948 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c05b85d8-610d-421d-b549-b96f83a6b1cf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:29.288039 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c05b85d8-610d-421d-b549-b96f83a6b1cf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1272 microversion: 2.1 time: 0.535266 Nov 12 02:26:29.289170 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 35/53] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:28 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1272 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:29.304116 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-de2c10cf-24d2-44be-a965-83ef3b46c2e5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:29.305203 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-de2c10cf-24d2-44be-a965-83ef3b46c2e5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:29.348460 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-de2c10cf-24d2-44be-a965-83ef3b46c2e5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:29.350180 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-de2c10cf-24d2-44be-a965-83ef3b46c2e5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:29.351374 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-de2c10cf-24d2-44be-a965-83ef3b46c2e5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:29.357079 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-de2c10cf-24d2-44be-a965-83ef3b46c2e5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:29.677152 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-de2c10cf-24d2-44be-a965-83ef3b46c2e5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:29.701587 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-de2c10cf-24d2-44be-a965-83ef3b46c2e5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1291 microversion: 2.1 time: 0.396194 Nov 12 02:26:29.702050 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 36/54] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:29 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1291 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:29.761333 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f2745b94-e09a-4662-b1d9-8610db34f1ef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:29.762832 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f2745b94-e09a-4662-b1d9-8610db34f1ef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:29.770292 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f2745b94-e09a-4662-b1d9-8610db34f1ef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:29.771203 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f2745b94-e09a-4662-b1d9-8610db34f1ef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:29.772447 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f2745b94-e09a-4662-b1d9-8610db34f1ef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:29.779825 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f2745b94-e09a-4662-b1d9-8610db34f1ef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:29.977879 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f2745b94-e09a-4662-b1d9-8610db34f1ef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:29.991359 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f2745b94-e09a-4662-b1d9-8610db34f1ef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1276 microversion: 2.1 time: 0.233384 Nov 12 02:26:29.992256 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 37/55] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:29 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1276 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:30.311855 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-38f308f0-c7aa-40a6-ab6e-95087dbf5135 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:30.313042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-38f308f0-c7aa-40a6-ab6e-95087dbf5135 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:30.347943 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-38f308f0-c7aa-40a6-ab6e-95087dbf5135 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:30.348739 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-38f308f0-c7aa-40a6-ab6e-95087dbf5135 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:30.362505 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-38f308f0-c7aa-40a6-ab6e-95087dbf5135 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:30.363231 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-38f308f0-c7aa-40a6-ab6e-95087dbf5135 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:30.675529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-38f308f0-c7aa-40a6-ab6e-95087dbf5135 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:30.683898 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-38f308f0-c7aa-40a6-ab6e-95087dbf5135 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1272 microversion: 2.1 time: 0.381889 Nov 12 02:26:30.695914 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 38/56] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:30 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1272 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:30.722175 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8f747564-3724-48bc-8149-082ff4553259 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:30.723599 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8f747564-3724-48bc-8149-082ff4553259 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:30.746950 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8f747564-3724-48bc-8149-082ff4553259 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:30.749895 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8f747564-3724-48bc-8149-082ff4553259 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:30.752978 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8f747564-3724-48bc-8149-082ff4553259 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:30.753933 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8f747564-3724-48bc-8149-082ff4553259 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:31.114119 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8f747564-3724-48bc-8149-082ff4553259 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:31.127134 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8f747564-3724-48bc-8149-082ff4553259 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1279 microversion: 2.1 time: 0.409249 Nov 12 02:26:31.134939 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 39/57] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:30 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1279 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:31.149387 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e361596c-4a0d-4b45-88eb-c3c49cefb84e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:31.156575 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e361596c-4a0d-4b45-88eb-c3c49cefb84e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:31.172581 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e361596c-4a0d-4b45-88eb-c3c49cefb84e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:31.173807 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e361596c-4a0d-4b45-88eb-c3c49cefb84e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:31.176489 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e361596c-4a0d-4b45-88eb-c3c49cefb84e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:31.178919 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e361596c-4a0d-4b45-88eb-c3c49cefb84e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:31.300097 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:26:31.300602 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:26:31.301057 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:26:31.301636 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:26:31.302198 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:26:31.319607 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:31.320310 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:31.321285 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:31.321871 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:31.364697 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Getting quotas for project 4e70a88f4b094066abaf2d0cd853f751. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:26:31.383872 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Getting quotas for user eec0f3e481084226af3e4cb004585024 and project 4e70a88f4b094066abaf2d0cd853f751. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:26:31.407081 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:26:31.409654 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:26:31.514635 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e5a76665-3fad-4d47-8785-cc5a422f197e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.476928 Nov 12 02:26:31.520925 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 19/58] 10.222.0.70 () {62 vars in 1187 bytes} [Fri Nov 12 02:26:28 2021] POST /compute/v2.1/servers => generated 402 bytes in 3484 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 12 02:26:32.229134 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7cd39595-e602-4636-b541-5e7728755ee7 tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] Action: 'create', calling method: .version_select at 0x7fc065293f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-774887978", "metadata": {"Type": "work"}}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:32.241385 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7cd39595-e602-4636-b541-5e7728755ee7 tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:26:32.244608 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7cd39595-e602-4636-b541-5e7728755ee7 tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.721403 Nov 12 02:26:32.253762 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 20/59] 10.222.0.70 () {60 vars in 1155 bytes} [Fri Nov 12 02:26:31 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 732 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 12 02:26:32.266652 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-14f562d9-4cda-419d-9095-da5585afa9a1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:32.273694 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-14f562d9-4cda-419d-9095-da5585afa9a1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:33.046964 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-14f562d9-4cda-419d-9095-da5585afa9a1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:33.059338 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-14f562d9-4cda-419d-9095-da5585afa9a1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:33.081488 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-14f562d9-4cda-419d-9095-da5585afa9a1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:33.083455 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-14f562d9-4cda-419d-9095-da5585afa9a1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1281 microversion: 2.20 time: 0.828260 Nov 12 02:26:33.091455 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 21/60] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:32 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1281 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:33.110827 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5f95d193-b782-4d1a-a1c8-4aefdd3ecb16 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:33.120732 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5f95d193-b782-4d1a-a1c8-4aefdd3ecb16 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:33.136673 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f95d193-b782-4d1a-a1c8-4aefdd3ecb16 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:33.139330 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f95d193-b782-4d1a-a1c8-4aefdd3ecb16 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:33.141983 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f95d193-b782-4d1a-a1c8-4aefdd3ecb16 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:33.143717 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f95d193-b782-4d1a-a1c8-4aefdd3ecb16 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:33.487454 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e361596c-4a0d-4b45-88eb-c3c49cefb84e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:33.497180 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e361596c-4a0d-4b45-88eb-c3c49cefb84e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 2.351348 Nov 12 02:26:33.501634 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 40/61] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:31 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 2356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:33.506728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8d741b67-5c48-4994-9641-95143809473b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:33.513287 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8d741b67-5c48-4994-9641-95143809473b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:33.529090 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d741b67-5c48-4994-9641-95143809473b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:33.529611 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d741b67-5c48-4994-9641-95143809473b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:33.530474 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d741b67-5c48-4994-9641-95143809473b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:33.531008 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d741b67-5c48-4994-9641-95143809473b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:33.709644 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8d741b67-5c48-4994-9641-95143809473b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:33.731990 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8d741b67-5c48-4994-9641-95143809473b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1279 microversion: 2.1 time: 0.229215 Nov 12 02:26:33.732577 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 41/62] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:33 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1279 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:33.746578 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5f95d193-b782-4d1a-a1c8-4aefdd3ecb16 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:33.757841 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5f95d193-b782-4d1a-a1c8-4aefdd3ecb16 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.651765 Nov 12 02:26:33.759014 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 22/63] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:33 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:33.765545 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fe860e4e-b66c-4e8d-bc26-0f95ad4d1ad2 tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] Action: 'create', calling method: .version_select at 0x7fc065261310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2033560934", "metadata": {"Type": "work"}}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:33.768356 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-452427387", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38363d6e-af24-4ec9-9ca9-8c61a2487f51"}], "security_groups": [{"name": "tempest-securitygroup--761788975"}], "key_name": "tempest-keypair-20366487", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:33.771185 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fe860e4e-b66c-4e8d-bc26-0f95ad4d1ad2 tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:26:33.775124 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-fe860e4e-b66c-4e8d-bc26-0f95ad4d1ad2 tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027086 Nov 12 02:26:33.779487 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 42/64] 10.222.0.70 () {60 vars in 1155 bytes} [Fri Nov 12 02:26:33 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 12 02:26:33.795754 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-34640c83-4dd5-408f-919d-cad4bfbc877f tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] Action: 'create', calling method: .version_select at 0x7fc065292160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1080200962", "metadata": {"Type": "work"}}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:33.796845 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-34640c83-4dd5-408f-919d-cad4bfbc877f tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:26:33.802341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-34640c83-4dd5-408f-919d-cad4bfbc877f tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014262 Nov 12 02:26:33.804123 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 43/65] 10.222.0.70 () {60 vars in 1155 bytes} [Fri Nov 12 02:26:33 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 12 02:26:33.813285 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-247d5f7e-76c2-4d2b-9ac2-93a1076227eb tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] Calling method '.version_select at 0x7fc066e07550>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:33.873646 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-247d5f7e-76c2-4d2b-9ac2-93a1076227eb tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] HTTP exception thrown: Volume tempest-invalid-1850213979 could not be found. Nov 12 02:26:33.874525 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-247d5f7e-76c2-4d2b-9ac2-93a1076227eb tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] Returning 404 to user: Volume tempest-invalid-1850213979 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:26:33.878608 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-247d5f7e-76c2-4d2b-9ac2-93a1076227eb tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1850213979" status: 404 len: 99 microversion: 2.1 time: 0.066567 Nov 12 02:26:33.879402 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 44/66] 10.222.0.70 () {58 vars in 1217 bytes} [Fri Nov 12 02:26:33 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1850213979 => generated 99 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 12 02:26:33.889618 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-dedc54b6-dfe3-4681-b4e3-a0bdec7889b3 tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004248 Nov 12 02:26:33.890713 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 45/67] 10.222.0.70 () {58 vars in 1139 bytes} [Fri Nov 12 02:26:33 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 12 02:26:33.902137 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1392e94d-6d4c-4c57-bb69-f2164ca83a5f tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005333 Nov 12 02:26:33.902909 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 46/68] 10.222.0.70 () {58 vars in 1136 bytes} [Fri Nov 12 02:26:33 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 12 02:26:33.912731 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-72c9bc4e-57ba-49cd-8e2b-761b71e732cd tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] Calling method '.version_select at 0x7fc065230310>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:33.947518 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-72c9bc4e-57ba-49cd-8e2b-761b71e732cd tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] HTTP exception thrown: Volume d09c3c57-43a2-495a-ad9a-cfd424b860c2 could not be found. Nov 12 02:26:33.948124 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-72c9bc4e-57ba-49cd-8e2b-761b71e732cd tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] Returning 404 to user: Volume d09c3c57-43a2-495a-ad9a-cfd424b860c2 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:26:33.948978 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-72c9bc4e-57ba-49cd-8e2b-761b71e732cd tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/d09c3c57-43a2-495a-ad9a-cfd424b860c2" status: 404 len: 109 microversion: 2.1 time: 0.040292 Nov 12 02:26:33.949697 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 47/69] 10.222.0.70 () {58 vars in 1247 bytes} [Fri Nov 12 02:26:33 2021] DELETE /compute/v2.1/os-volumes/d09c3c57-43a2-495a-ad9a-cfd424b860c2 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:26:33.960393 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-def95ae8-3206-4ab5-8825-48501ed3bf0e tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] Calling method '.version_select at 0x7fc0652300d0>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:33.992673 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-def95ae8-3206-4ab5-8825-48501ed3bf0e tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] HTTP exception thrown: Volume 0f297224-c8f6-4ed7-9e03-a800644db5d6 could not be found. Nov 12 02:26:33.993300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-def95ae8-3206-4ab5-8825-48501ed3bf0e tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] Returning 404 to user: Volume 0f297224-c8f6-4ed7-9e03-a800644db5d6 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:26:33.994190 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-def95ae8-3206-4ab5-8825-48501ed3bf0e tempest-VolumesNegativeTest-1283987083 tempest-VolumesNegativeTest-1283987083-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/0f297224-c8f6-4ed7-9e03-a800644db5d6" status: 404 len: 109 microversion: 2.1 time: 0.037886 Nov 12 02:26:33.994901 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 48/70] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:26:33 2021] GET /compute/v2.1/os-volumes/0f297224-c8f6-4ed7-9e03-a800644db5d6 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:26:34.084204 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] validate_networks() for [('38363d6e-af24-4ec9-9ca9-8c61a2487f51', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:26:34.111475 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-44cdaef5-ff53-4436-8fee-8345a1755eae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:34.112086 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-44cdaef5-ff53-4436-8fee-8345a1755eae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:34.122441 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44cdaef5-ff53-4436-8fee-8345a1755eae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:34.122967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44cdaef5-ff53-4436-8fee-8345a1755eae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:34.124324 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44cdaef5-ff53-4436-8fee-8345a1755eae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:34.125445 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44cdaef5-ff53-4436-8fee-8345a1755eae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:34.219674 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-44cdaef5-ff53-4436-8fee-8345a1755eae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:34.237973 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-44cdaef5-ff53-4436-8fee-8345a1755eae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:34.244896 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-44cdaef5-ff53-4436-8fee-8345a1755eae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:34.246121 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-44cdaef5-ff53-4436-8fee-8345a1755eae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1333 microversion: 2.20 time: 0.138432 Nov 12 02:26:34.247052 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 49/71] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:34 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1333 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:26:34.522872 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ee91da90-3fcd-4e4a-8f8c-30c509372310 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:34.524055 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ee91da90-3fcd-4e4a-8f8c-30c509372310 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:34.536176 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ee91da90-3fcd-4e4a-8f8c-30c509372310 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:34.536954 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ee91da90-3fcd-4e4a-8f8c-30c509372310 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:34.538681 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ee91da90-3fcd-4e4a-8f8c-30c509372310 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:34.539432 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ee91da90-3fcd-4e4a-8f8c-30c509372310 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:34.801041 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:26:34.801813 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:26:34.802495 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:26:34.811694 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:26:34.812284 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:26:34.846998 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:34.847822 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:34.854717 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:34.855198 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:34.883162 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Getting quotas for project 77e4b228dda14fa7852c7fe639ed28b0. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:26:34.888314 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Getting quotas for user 808aadbd72b54806add54c601d755481 and project 77e4b228dda14fa7852c7fe639ed28b0. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:26:34.909360 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:26:34.912698 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:26:34.937946 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ee91da90-3fcd-4e4a-8f8c-30c509372310 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:34.952026 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ee91da90-3fcd-4e4a-8f8c-30c509372310 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.435813 Nov 12 02:26:34.967595 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 50/72] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:34 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:34.985893 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-06cdc543-41b6-4260-bb77-5783d7ced326 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:34.985893 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-06cdc543-41b6-4260-bb77-5783d7ced326 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:35.000337 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1cb4edc5-99c8-4ec7-a4e3-22b889da0dc5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.239839 Nov 12 02:26:35.006959 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 23/73] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:26:33 2021] POST /compute/v2.1/servers => generated 401 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:26:35.016646 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-26881297-de80-486a-ac6e-78a0ca472b95 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:35.017180 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-26881297-de80-486a-ac6e-78a0ca472b95 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:35.018590 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-06cdc543-41b6-4260-bb77-5783d7ced326 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:35.019066 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-06cdc543-41b6-4260-bb77-5783d7ced326 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:35.020125 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-06cdc543-41b6-4260-bb77-5783d7ced326 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:35.020432 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-06cdc543-41b6-4260-bb77-5783d7ced326 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:35.026709 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26881297-de80-486a-ac6e-78a0ca472b95 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:35.026709 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26881297-de80-486a-ac6e-78a0ca472b95 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:35.026709 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26881297-de80-486a-ac6e-78a0ca472b95 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:35.026709 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26881297-de80-486a-ac6e-78a0ca472b95 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:35.319494 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-26881297-de80-486a-ac6e-78a0ca472b95 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:35.332073 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-26881297-de80-486a-ac6e-78a0ca472b95 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.323606 Nov 12 02:26:35.332965 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 24/74] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:35 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:35.344222 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-06cdc543-41b6-4260-bb77-5783d7ced326 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:35.360980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6f3db402-aad8-44cc-88f5-755196a749e3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:35.367199 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6f3db402-aad8-44cc-88f5-755196a749e3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:35.368626 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-06cdc543-41b6-4260-bb77-5783d7ced326 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.399330 Nov 12 02:26:35.369235 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 51/75] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:34 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:35.382930 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9019e7f2-9ce6-417e-802b-fd42f5e9de4e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:35.385058 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9019e7f2-9ce6-417e-802b-fd42f5e9de4e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:35.391577 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9019e7f2-9ce6-417e-802b-fd42f5e9de4e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:35.392257 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9019e7f2-9ce6-417e-802b-fd42f5e9de4e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:35.393196 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9019e7f2-9ce6-417e-802b-fd42f5e9de4e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:35.393778 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9019e7f2-9ce6-417e-802b-fd42f5e9de4e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:35.553703 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6f3db402-aad8-44cc-88f5-755196a749e3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:35.570166 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6f3db402-aad8-44cc-88f5-755196a749e3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1235 microversion: 2.1 time: 0.218860 Nov 12 02:26:35.582260 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 25/76] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:35 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1235 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:35.595312 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9019e7f2-9ce6-417e-802b-fd42f5e9de4e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:35.606640 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9019e7f2-9ce6-417e-802b-fd42f5e9de4e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:35.608840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9019e7f2-9ce6-417e-802b-fd42f5e9de4e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:35.610303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9019e7f2-9ce6-417e-802b-fd42f5e9de4e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1333 microversion: 2.20 time: 0.232691 Nov 12 02:26:35.611378 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 52/77] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:35 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1333 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:35.972325 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-05debad6-ccc7-45b8-89a4-8caaa21e5085 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:35.972952 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-05debad6-ccc7-45b8-89a4-8caaa21e5085 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:35.980375 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-05debad6-ccc7-45b8-89a4-8caaa21e5085 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:35.980836 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-05debad6-ccc7-45b8-89a4-8caaa21e5085 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:35.981645 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-05debad6-ccc7-45b8-89a4-8caaa21e5085 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:35.983829 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-05debad6-ccc7-45b8-89a4-8caaa21e5085 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:36.297856 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-05debad6-ccc7-45b8-89a4-8caaa21e5085 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:36.309823 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-05debad6-ccc7-45b8-89a4-8caaa21e5085 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.341725 Nov 12 02:26:36.311193 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 26/78] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:35 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:36.349189 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-85eb3ebf-1a95-4179-815e-4abf3a7e186f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:36.349842 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-85eb3ebf-1a95-4179-815e-4abf3a7e186f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:36.364523 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-85eb3ebf-1a95-4179-815e-4abf3a7e186f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:36.365509 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-85eb3ebf-1a95-4179-815e-4abf3a7e186f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:36.366614 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-85eb3ebf-1a95-4179-815e-4abf3a7e186f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:36.367220 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-85eb3ebf-1a95-4179-815e-4abf3a7e186f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:36.385723 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f40a08b7-b0ca-428a-8dc9-255e02899940 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:36.387207 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f40a08b7-b0ca-428a-8dc9-255e02899940 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:36.400053 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f40a08b7-b0ca-428a-8dc9-255e02899940 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:36.404385 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f40a08b7-b0ca-428a-8dc9-255e02899940 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:36.406588 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f40a08b7-b0ca-428a-8dc9-255e02899940 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:36.407449 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f40a08b7-b0ca-428a-8dc9-255e02899940 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:36.723657 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f40a08b7-b0ca-428a-8dc9-255e02899940 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:36.736915 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-85eb3ebf-1a95-4179-815e-4abf3a7e186f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:36.744198 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f40a08b7-b0ca-428a-8dc9-255e02899940 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.361930 Nov 12 02:26:36.745356 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-85eb3ebf-1a95-4179-815e-4abf3a7e186f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.399793 Nov 12 02:26:36.746190 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 27/79] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:36 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:36.756100 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 53/80] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:36 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:36.762616 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0a089e2c-07e8-40b2-9a4a-ab81034f777a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:36.763514 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0a089e2c-07e8-40b2-9a4a-ab81034f777a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:36.771306 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f7e54469-1829-4bb3-a03e-d47d95e5c911 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:36.774024 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f7e54469-1829-4bb3-a03e-d47d95e5c911 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:36.781738 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7e54469-1829-4bb3-a03e-d47d95e5c911 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:36.782556 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7e54469-1829-4bb3-a03e-d47d95e5c911 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:36.783352 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0a089e2c-07e8-40b2-9a4a-ab81034f777a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:36.783579 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7e54469-1829-4bb3-a03e-d47d95e5c911 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:36.783807 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0a089e2c-07e8-40b2-9a4a-ab81034f777a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:36.784217 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7e54469-1829-4bb3-a03e-d47d95e5c911 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:36.784980 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0a089e2c-07e8-40b2-9a4a-ab81034f777a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:36.785576 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0a089e2c-07e8-40b2-9a4a-ab81034f777a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:36.868321 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f7e54469-1829-4bb3-a03e-d47d95e5c911 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:36.885106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f7e54469-1829-4bb3-a03e-d47d95e5c911 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1239 microversion: 2.1 time: 0.130605 Nov 12 02:26:36.887595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 28/81] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:36 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1239 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:36.906454 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0a089e2c-07e8-40b2-9a4a-ab81034f777a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:36.916917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0a089e2c-07e8-40b2-9a4a-ab81034f777a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:36.919681 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0a089e2c-07e8-40b2-9a4a-ab81034f777a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:36.921009 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0a089e2c-07e8-40b2-9a4a-ab81034f777a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1333 microversion: 2.20 time: 0.163699 Nov 12 02:26:36.922413 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 54/82] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:36 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1333 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:37.328109 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-663e09c2-9131-49d3-9a55-0ea3c3a6b1cf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:37.329120 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-663e09c2-9131-49d3-9a55-0ea3c3a6b1cf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:37.337805 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-663e09c2-9131-49d3-9a55-0ea3c3a6b1cf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:37.338263 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-663e09c2-9131-49d3-9a55-0ea3c3a6b1cf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:37.339133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-663e09c2-9131-49d3-9a55-0ea3c3a6b1cf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:37.339568 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-663e09c2-9131-49d3-9a55-0ea3c3a6b1cf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:37.557984 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-663e09c2-9131-49d3-9a55-0ea3c3a6b1cf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:37.567499 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-663e09c2-9131-49d3-9a55-0ea3c3a6b1cf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.243022 Nov 12 02:26:37.568265 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 29/83] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:37 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:37.768070 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-18dca3ed-5c57-4d59-8907-6e83eff7e753 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:37.770872 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-18dca3ed-5c57-4d59-8907-6e83eff7e753 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:37.775636 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8c2eeb0a-1d7b-4f58-aaa4-a5fd3017d5c0 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:37.776264 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8c2eeb0a-1d7b-4f58-aaa4-a5fd3017d5c0 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:37.786534 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18dca3ed-5c57-4d59-8907-6e83eff7e753 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:37.788811 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c2eeb0a-1d7b-4f58-aaa4-a5fd3017d5c0 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:37.789468 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18dca3ed-5c57-4d59-8907-6e83eff7e753 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:37.790208 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c2eeb0a-1d7b-4f58-aaa4-a5fd3017d5c0 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:37.791188 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c2eeb0a-1d7b-4f58-aaa4-a5fd3017d5c0 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:37.791918 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18dca3ed-5c57-4d59-8907-6e83eff7e753 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:37.792486 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18dca3ed-5c57-4d59-8907-6e83eff7e753 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:37.793121 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c2eeb0a-1d7b-4f58-aaa4-a5fd3017d5c0 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:38.082163 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-18dca3ed-5c57-4d59-8907-6e83eff7e753 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:38.091864 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-18dca3ed-5c57-4d59-8907-6e83eff7e753 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.332004 Nov 12 02:26:38.092997 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 55/84] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:37 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:38.097641 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8fe5bbe7-5e38-4d1d-9223-ff5de229ea78 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:38.098452 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8fe5bbe7-5e38-4d1d-9223-ff5de229ea78 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:38.105283 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8fe5bbe7-5e38-4d1d-9223-ff5de229ea78 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:38.106091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8fe5bbe7-5e38-4d1d-9223-ff5de229ea78 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:38.107089 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8fe5bbe7-5e38-4d1d-9223-ff5de229ea78 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:38.107670 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8fe5bbe7-5e38-4d1d-9223-ff5de229ea78 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:38.109637 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8c2eeb0a-1d7b-4f58-aaa4-a5fd3017d5c0 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:38.129804 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8c2eeb0a-1d7b-4f58-aaa4-a5fd3017d5c0 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.358086 Nov 12 02:26:38.132114 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 30/85] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:37 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:38.152509 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9275554f-cc2a-4e06-90cb-3fb40d710ec3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:38.153568 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9275554f-cc2a-4e06-90cb-3fb40d710ec3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:38.160422 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9275554f-cc2a-4e06-90cb-3fb40d710ec3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:38.161212 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9275554f-cc2a-4e06-90cb-3fb40d710ec3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:38.161967 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9275554f-cc2a-4e06-90cb-3fb40d710ec3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:38.162580 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9275554f-cc2a-4e06-90cb-3fb40d710ec3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:38.184071 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8fe5bbe7-5e38-4d1d-9223-ff5de229ea78 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:38.192286 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8fe5bbe7-5e38-4d1d-9223-ff5de229ea78 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1239 microversion: 2.1 time: 0.098085 Nov 12 02:26:38.193177 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 56/86] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:38 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1239 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:38.225679 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9275554f-cc2a-4e06-90cb-3fb40d710ec3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:38.233941 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9275554f-cc2a-4e06-90cb-3fb40d710ec3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:38.236504 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9275554f-cc2a-4e06-90cb-3fb40d710ec3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:38.237662 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9275554f-cc2a-4e06-90cb-3fb40d710ec3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1333 microversion: 2.20 time: 0.104306 Nov 12 02:26:38.238214 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 31/87] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:38 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1333 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:38.585163 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-cd6e998a-d04e-4f6d-91e6-9a9b1fcc3eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:38.585718 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-cd6e998a-d04e-4f6d-91e6-9a9b1fcc3eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:38.593006 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cd6e998a-d04e-4f6d-91e6-9a9b1fcc3eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:38.593746 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cd6e998a-d04e-4f6d-91e6-9a9b1fcc3eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:38.595094 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cd6e998a-d04e-4f6d-91e6-9a9b1fcc3eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:38.595941 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cd6e998a-d04e-4f6d-91e6-9a9b1fcc3eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:38.757490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cd6e998a-d04e-4f6d-91e6-9a9b1fcc3eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:38.765492 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-cd6e998a-d04e-4f6d-91e6-9a9b1fcc3eef tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.184019 Nov 12 02:26:38.766056 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 57/88] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:38 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:39.112116 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-019fad52-2aaa-490c-8d76-b5342c128019 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:39.113150 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-019fad52-2aaa-490c-8d76-b5342c128019 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:39.120266 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-019fad52-2aaa-490c-8d76-b5342c128019 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:39.120852 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-019fad52-2aaa-490c-8d76-b5342c128019 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:39.121787 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-019fad52-2aaa-490c-8d76-b5342c128019 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:39.122328 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-019fad52-2aaa-490c-8d76-b5342c128019 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:39.155321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-dd8b54d2-7088-419c-9ef9-15d3b31e18ad tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:39.156702 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-dd8b54d2-7088-419c-9ef9-15d3b31e18ad tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:39.163887 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dd8b54d2-7088-419c-9ef9-15d3b31e18ad tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:39.164380 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dd8b54d2-7088-419c-9ef9-15d3b31e18ad tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:39.165256 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dd8b54d2-7088-419c-9ef9-15d3b31e18ad tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:39.165691 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dd8b54d2-7088-419c-9ef9-15d3b31e18ad tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:39.391677 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-019fad52-2aaa-490c-8d76-b5342c128019 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:39.394176 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-dd8b54d2-7088-419c-9ef9-15d3b31e18ad tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:39.402261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-dd8b54d2-7088-419c-9ef9-15d3b31e18ad tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.258759 Nov 12 02:26:39.402958 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-019fad52-2aaa-490c-8d76-b5342c128019 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.296330 Nov 12 02:26:39.406913 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 58/89] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:39 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:39.407684 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4d3f261d-e4cf-42d5-98cf-6347ad5f8931 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:39.408440 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4d3f261d-e4cf-42d5-98cf-6347ad5f8931 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:39.410737 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 32/90] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:39 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:39.415027 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4d3f261d-e4cf-42d5-98cf-6347ad5f8931 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:39.415648 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4d3f261d-e4cf-42d5-98cf-6347ad5f8931 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:39.416559 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4d3f261d-e4cf-42d5-98cf-6347ad5f8931 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:39.417128 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4d3f261d-e4cf-42d5-98cf-6347ad5f8931 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:39.421404 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8f858f72-48e0-4aaf-9a7b-731f809fb679 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:39.422038 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8f858f72-48e0-4aaf-9a7b-731f809fb679 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:39.434279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f858f72-48e0-4aaf-9a7b-731f809fb679 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:39.434755 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f858f72-48e0-4aaf-9a7b-731f809fb679 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:39.435610 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f858f72-48e0-4aaf-9a7b-731f809fb679 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:39.436051 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f858f72-48e0-4aaf-9a7b-731f809fb679 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:39.484721 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4d3f261d-e4cf-42d5-98cf-6347ad5f8931 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:39.494631 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4d3f261d-e4cf-42d5-98cf-6347ad5f8931 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1239 microversion: 2.1 time: 0.089696 Nov 12 02:26:39.495375 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 59/91] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:39 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1239 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:39.516490 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8f858f72-48e0-4aaf-9a7b-731f809fb679 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:39.526376 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8f858f72-48e0-4aaf-9a7b-731f809fb679 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:39.527365 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8f858f72-48e0-4aaf-9a7b-731f809fb679 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:39.528657 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8f858f72-48e0-4aaf-9a7b-731f809fb679 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1333 microversion: 2.20 time: 0.116693 Nov 12 02:26:39.530756 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 33/92] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:39 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1333 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:39.781300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f4f515e2-f447-4d4b-bfa9-61dde609f6de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:39.781904 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f4f515e2-f447-4d4b-bfa9-61dde609f6de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:39.789719 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f4f515e2-f447-4d4b-bfa9-61dde609f6de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:39.790360 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f4f515e2-f447-4d4b-bfa9-61dde609f6de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:39.791333 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f4f515e2-f447-4d4b-bfa9-61dde609f6de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:39.791909 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f4f515e2-f447-4d4b-bfa9-61dde609f6de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:39.961331 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f4f515e2-f447-4d4b-bfa9-61dde609f6de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:39.969138 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f4f515e2-f447-4d4b-bfa9-61dde609f6de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.191334 Nov 12 02:26:39.978714 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 60/93] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:39 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:40.421994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-29b753d0-4adb-4ffa-b5a7-6d28f901a03f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:40.421994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-29b753d0-4adb-4ffa-b5a7-6d28f901a03f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:40.429132 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9fa1ee0c-6764-4e22-81ec-c54f909bb88e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:40.430357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9fa1ee0c-6764-4e22-81ec-c54f909bb88e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:40.442860 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-29b753d0-4adb-4ffa-b5a7-6d28f901a03f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:40.446134 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-29b753d0-4adb-4ffa-b5a7-6d28f901a03f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:40.448934 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9fa1ee0c-6764-4e22-81ec-c54f909bb88e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:40.453619 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-29b753d0-4adb-4ffa-b5a7-6d28f901a03f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:40.454029 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-29b753d0-4adb-4ffa-b5a7-6d28f901a03f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:40.454860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9fa1ee0c-6764-4e22-81ec-c54f909bb88e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:40.456120 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9fa1ee0c-6764-4e22-81ec-c54f909bb88e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:40.464701 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9fa1ee0c-6764-4e22-81ec-c54f909bb88e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:41.110742 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-29b753d0-4adb-4ffa-b5a7-6d28f901a03f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:41.129851 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-29b753d0-4adb-4ffa-b5a7-6d28f901a03f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.715077 Nov 12 02:26:41.132544 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 34/94] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:40 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:41.147471 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7456a19a-19f4-42c3-bcc5-3049c359cb49 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:41.149254 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7456a19a-19f4-42c3-bcc5-3049c359cb49 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:41.169822 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7456a19a-19f4-42c3-bcc5-3049c359cb49 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:41.170293 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7456a19a-19f4-42c3-bcc5-3049c359cb49 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:41.174429 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7456a19a-19f4-42c3-bcc5-3049c359cb49 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:41.179125 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7456a19a-19f4-42c3-bcc5-3049c359cb49 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:41.223701 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9fa1ee0c-6764-4e22-81ec-c54f909bb88e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:41.233322 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9fa1ee0c-6764-4e22-81ec-c54f909bb88e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.812818 Nov 12 02:26:41.251596 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 61/95] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:40 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:41.263368 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-162434e4-3242-4558-8f53-79bbb0d6691c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:41.264264 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-162434e4-3242-4558-8f53-79bbb0d6691c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:41.271557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-162434e4-3242-4558-8f53-79bbb0d6691c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:41.272323 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-162434e4-3242-4558-8f53-79bbb0d6691c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:41.273683 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-162434e4-3242-4558-8f53-79bbb0d6691c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:41.274743 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-162434e4-3242-4558-8f53-79bbb0d6691c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:41.310581 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7456a19a-19f4-42c3-bcc5-3049c359cb49 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:41.327435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7456a19a-19f4-42c3-bcc5-3049c359cb49 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1287 microversion: 2.1 time: 0.187648 Nov 12 02:26:41.328732 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 35/96] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:41 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1287 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:41.336803 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-73fea8b2-b100-4fa4-8272-15530595cafe tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:41.338194 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-73fea8b2-b100-4fa4-8272-15530595cafe tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:41.351846 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73fea8b2-b100-4fa4-8272-15530595cafe tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:41.352309 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73fea8b2-b100-4fa4-8272-15530595cafe tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:41.354979 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73fea8b2-b100-4fa4-8272-15530595cafe tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:41.355413 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73fea8b2-b100-4fa4-8272-15530595cafe tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:41.478216 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-162434e4-3242-4558-8f53-79bbb0d6691c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:41.493447 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-162434e4-3242-4558-8f53-79bbb0d6691c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:41.498035 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-162434e4-3242-4558-8f53-79bbb0d6691c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:41.502503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-162434e4-3242-4558-8f53-79bbb0d6691c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1339 microversion: 2.20 time: 0.249145 Nov 12 02:26:41.504958 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 62/97] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:41 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1339 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:41.723247 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-73fea8b2-b100-4fa4-8272-15530595cafe tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:41.735156 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-73fea8b2-b100-4fa4-8272-15530595cafe tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.404926 Nov 12 02:26:41.737371 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 36/98] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:41 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:42.148582 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8f23ed66-fe85-4268-abeb-0c8662a15837 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:42.149300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8f23ed66-fe85-4268-abeb-0c8662a15837 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:42.159579 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8f23ed66-fe85-4268-abeb-0c8662a15837 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:42.161448 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8f23ed66-fe85-4268-abeb-0c8662a15837 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:42.165457 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8f23ed66-fe85-4268-abeb-0c8662a15837 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:42.166230 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8f23ed66-fe85-4268-abeb-0c8662a15837 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:42.268292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-31b1e74d-b576-4ca1-bee3-0d81cc7a06b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:42.269148 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-31b1e74d-b576-4ca1-bee3-0d81cc7a06b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:42.281727 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31b1e74d-b576-4ca1-bee3-0d81cc7a06b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:42.282493 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31b1e74d-b576-4ca1-bee3-0d81cc7a06b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:42.283554 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31b1e74d-b576-4ca1-bee3-0d81cc7a06b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:42.288509 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31b1e74d-b576-4ca1-bee3-0d81cc7a06b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:42.661986 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8f23ed66-fe85-4268-abeb-0c8662a15837 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:42.669621 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8f23ed66-fe85-4268-abeb-0c8662a15837 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.525479 Nov 12 02:26:42.677282 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 63/99] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:42 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:42.683688 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9c27eba8-a331-4d17-830f-8c4c981f6628 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:42.684651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9c27eba8-a331-4d17-830f-8c4c981f6628 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:42.691909 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9c27eba8-a331-4d17-830f-8c4c981f6628 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:42.692351 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9c27eba8-a331-4d17-830f-8c4c981f6628 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:42.693126 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9c27eba8-a331-4d17-830f-8c4c981f6628 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:42.694267 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9c27eba8-a331-4d17-830f-8c4c981f6628 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:42.764494 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-31b1e74d-b576-4ca1-bee3-0d81cc7a06b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:42.771853 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-31b1e74d-b576-4ca1-bee3-0d81cc7a06b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.507231 Nov 12 02:26:42.772454 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 37/100] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:42 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:42.781245 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-619c1fe9-70ff-4603-9011-3f78f225264c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:42.781857 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-619c1fe9-70ff-4603-9011-3f78f225264c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:42.788337 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-619c1fe9-70ff-4603-9011-3f78f225264c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:42.788840 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-619c1fe9-70ff-4603-9011-3f78f225264c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:42.789791 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-619c1fe9-70ff-4603-9011-3f78f225264c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:42.790373 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-619c1fe9-70ff-4603-9011-3f78f225264c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:42.902758 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9c27eba8-a331-4d17-830f-8c4c981f6628 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:42.907479 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9c27eba8-a331-4d17-830f-8c4c981f6628 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1293 microversion: 2.1 time: 0.228359 Nov 12 02:26:42.911552 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 64/101] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:42 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1293 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:42.921117 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a8cffcd9-3427-4006-a2e8-422665f3c522 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:42.922477 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a8cffcd9-3427-4006-a2e8-422665f3c522 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:42.939542 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a8cffcd9-3427-4006-a2e8-422665f3c522 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:42.940259 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a8cffcd9-3427-4006-a2e8-422665f3c522 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:42.941426 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a8cffcd9-3427-4006-a2e8-422665f3c522 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:42.942156 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a8cffcd9-3427-4006-a2e8-422665f3c522 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:42.986216 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-619c1fe9-70ff-4603-9011-3f78f225264c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:43.003300 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-619c1fe9-70ff-4603-9011-3f78f225264c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:43.004895 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-619c1fe9-70ff-4603-9011-3f78f225264c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:43.006279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-619c1fe9-70ff-4603-9011-3f78f225264c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1339 microversion: 2.20 time: 0.228644 Nov 12 02:26:43.017159 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 38/102] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:42 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1339 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:43.099506 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-8a56ec06-d2ce-49d3-885a-585bf700d6a5 req-ed3dd766-1b9f-4160-8cf0-f486442ad51e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8244b795-8dd2-43ee-a703-79b742cd5432", "tag": "65d1110b-f099-4749-9cc9-cc0fbaf8af9c"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:43.101706 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:26:43.101706 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:26:43.112912 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-8a56ec06-d2ce-49d3-885a-585bf700d6a5 req-ed3dd766-1b9f-4160-8cf0-f486442ad51e service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:43.113353 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-8a56ec06-d2ce-49d3-885a-585bf700d6a5 req-ed3dd766-1b9f-4160-8cf0-f486442ad51e service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:43.138547 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-8a56ec06-d2ce-49d3-885a-585bf700d6a5 req-ed3dd766-1b9f-4160-8cf0-f486442ad51e service nova] Creating event network-changed:65d1110b-f099-4749-9cc9-cc0fbaf8af9c for instance 8244b795-8dd2-43ee-a703-79b742cd5432 on hv-cinder-80857 Nov 12 02:26:43.139301 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-8a56ec06-d2ce-49d3-885a-585bf700d6a5 req-ed3dd766-1b9f-4160-8cf0-f486442ad51e service nova] Acquired lock "compute-rpcapi-router" {{(pid=116098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 12 02:26:43.150475 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8fcb6e56-e697-4453-8e66-fb36182f893d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:43.152134 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8fcb6e56-e697-4453-8e66-fb36182f893d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:43.155256 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8fcb6e56-e697-4453-8e66-fb36182f893d None None] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:43.155765 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8fcb6e56-e697-4453-8e66-fb36182f893d None None] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:43.165897 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.compute.rpcapi [None req-8fcb6e56-e697-4453-8e66-fb36182f893d None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 12 02:26:43.166980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8fcb6e56-e697-4453-8e66-fb36182f893d None None] Releasing lock "compute-rpcapi-router" {{(pid=116098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 12 02:26:43.209832 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8fcb6e56-e697-4453-8e66-fb36182f893d None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191190 Nov 12 02:26:43.213629 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 39/103] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:26:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:43.247372 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a8cffcd9-3427-4006-a2e8-422665f3c522 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:43.256258 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a8cffcd9-3427-4006-a2e8-422665f3c522 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.342614 Nov 12 02:26:43.257840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 65/104] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:42 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:43.688619 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1b8f1300-60c9-410c-9800-0f3e8d2e3ea4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:43.689623 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1b8f1300-60c9-410c-9800-0f3e8d2e3ea4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:43.697242 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b8f1300-60c9-410c-9800-0f3e8d2e3ea4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:43.697896 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b8f1300-60c9-410c-9800-0f3e8d2e3ea4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:43.699093 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b8f1300-60c9-410c-9800-0f3e8d2e3ea4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:43.699093 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b8f1300-60c9-410c-9800-0f3e8d2e3ea4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:43.808541 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-41ef1ac6-ea35-47d9-a12c-318bb68cbeeb req-bd3aea97-5acf-46d4-a792-b90925776970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701cf4eb-6d33-4aa4-a762-2cae743dd618", "tag": "b7a3e8e1-ad9e-43fd-945c-a4294eb6d9b9"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:43.810963 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:26:43.810963 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:26:43.821207 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-41ef1ac6-ea35-47d9-a12c-318bb68cbeeb req-bd3aea97-5acf-46d4-a792-b90925776970 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:43.821962 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-41ef1ac6-ea35-47d9-a12c-318bb68cbeeb req-bd3aea97-5acf-46d4-a792-b90925776970 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:43.842143 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-41ef1ac6-ea35-47d9-a12c-318bb68cbeeb req-bd3aea97-5acf-46d4-a792-b90925776970 service nova] Creating event network-changed:b7a3e8e1-ad9e-43fd-945c-a4294eb6d9b9 for instance 701cf4eb-6d33-4aa4-a762-2cae743dd618 on hv-cinder-80857 Nov 12 02:26:43.842702 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-41ef1ac6-ea35-47d9-a12c-318bb68cbeeb req-bd3aea97-5acf-46d4-a792-b90925776970 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 12 02:26:43.843848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-edbbe666-21d9-400d-89fc-3dfae4a76721 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:43.844288 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-edbbe666-21d9-400d-89fc-3dfae4a76721 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:43.845238 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-edbbe666-21d9-400d-89fc-3dfae4a76721 None None] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:43.845674 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-edbbe666-21d9-400d-89fc-3dfae4a76721 None None] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:43.856472 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.compute.rpcapi [None req-edbbe666-21d9-400d-89fc-3dfae4a76721 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 12 02:26:43.857364 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-edbbe666-21d9-400d-89fc-3dfae4a76721 None None] Releasing lock "compute-rpcapi-router" {{(pid=116099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 12 02:26:43.882777 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-edbbe666-21d9-400d-89fc-3dfae4a76721 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139754 Nov 12 02:26:43.883872 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 66/105] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:26:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:26:43.890124 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7b58aa97-5743-4ad4-925c-50247220cbef tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:43.891286 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7b58aa97-5743-4ad4-925c-50247220cbef tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:43.904934 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b58aa97-5743-4ad4-925c-50247220cbef tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:43.905115 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1b8f1300-60c9-410c-9800-0f3e8d2e3ea4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:43.905754 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b58aa97-5743-4ad4-925c-50247220cbef tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:43.905754 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b58aa97-5743-4ad4-925c-50247220cbef tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:43.905754 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b58aa97-5743-4ad4-925c-50247220cbef tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:43.915915 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1b8f1300-60c9-410c-9800-0f3e8d2e3ea4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.231285 Nov 12 02:26:43.916504 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 40/106] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:43 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:43.930762 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-50d8e918-fe91-4c0e-bbb7-5fbfde8b16d0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:43.931536 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-50d8e918-fe91-4c0e-bbb7-5fbfde8b16d0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:43.939778 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-50d8e918-fe91-4c0e-bbb7-5fbfde8b16d0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:43.940468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-50d8e918-fe91-4c0e-bbb7-5fbfde8b16d0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:43.941637 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-50d8e918-fe91-4c0e-bbb7-5fbfde8b16d0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:43.942079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-50d8e918-fe91-4c0e-bbb7-5fbfde8b16d0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:44.009537 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-50d8e918-fe91-4c0e-bbb7-5fbfde8b16d0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:44.017573 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-50d8e918-fe91-4c0e-bbb7-5fbfde8b16d0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1293 microversion: 2.1 time: 0.091847 Nov 12 02:26:44.018169 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 41/107] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:43 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:44.025997 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0a556731-14b1-47ec-8d9e-63685cdb6f47 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:44.026897 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0a556731-14b1-47ec-8d9e-63685cdb6f47 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:44.039464 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0a556731-14b1-47ec-8d9e-63685cdb6f47 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:44.040137 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0a556731-14b1-47ec-8d9e-63685cdb6f47 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:44.041110 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0a556731-14b1-47ec-8d9e-63685cdb6f47 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:44.041536 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0a556731-14b1-47ec-8d9e-63685cdb6f47 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:44.096023 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7b58aa97-5743-4ad4-925c-50247220cbef tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:44.104325 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7b58aa97-5743-4ad4-925c-50247220cbef tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.219196 Nov 12 02:26:44.105089 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 67/108] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:43 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:44.198499 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0a556731-14b1-47ec-8d9e-63685cdb6f47 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:44.206228 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0a556731-14b1-47ec-8d9e-63685cdb6f47 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:44.207821 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0a556731-14b1-47ec-8d9e-63685cdb6f47 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:44.209461 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0a556731-14b1-47ec-8d9e-63685cdb6f47 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.188252 Nov 12 02:26:44.210030 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 42/109] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:44 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:44.274692 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-394d4b06-c94a-4aa6-8222-d0040e55fc10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:44.275320 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-394d4b06-c94a-4aa6-8222-d0040e55fc10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:44.286570 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-394d4b06-c94a-4aa6-8222-d0040e55fc10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:44.286570 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-394d4b06-c94a-4aa6-8222-d0040e55fc10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:44.286570 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-394d4b06-c94a-4aa6-8222-d0040e55fc10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:44.286570 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-394d4b06-c94a-4aa6-8222-d0040e55fc10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:44.435025 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-394d4b06-c94a-4aa6-8222-d0040e55fc10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:44.442588 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-394d4b06-c94a-4aa6-8222-d0040e55fc10 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.171915 Nov 12 02:26:44.443226 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 68/110] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:44 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:44.933375 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b7e92e22-daee-41aa-babd-2f2948e95e18 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:44.934021 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b7e92e22-daee-41aa-babd-2f2948e95e18 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:44.941354 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7e92e22-daee-41aa-babd-2f2948e95e18 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:44.942160 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7e92e22-daee-41aa-babd-2f2948e95e18 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:44.943365 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7e92e22-daee-41aa-babd-2f2948e95e18 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:44.944145 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7e92e22-daee-41aa-babd-2f2948e95e18 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:45.050048 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-500ae5d6-29ee-4d2e-b04d-348ec4d57b89 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:45.050656 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-500ae5d6-29ee-4d2e-b04d-348ec4d57b89 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:45.063836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-500ae5d6-29ee-4d2e-b04d-348ec4d57b89 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:45.064277 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-500ae5d6-29ee-4d2e-b04d-348ec4d57b89 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:45.065060 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-500ae5d6-29ee-4d2e-b04d-348ec4d57b89 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:45.065753 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-500ae5d6-29ee-4d2e-b04d-348ec4d57b89 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:45.132944 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b7e92e22-daee-41aa-babd-2f2948e95e18 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:45.142428 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b7e92e22-daee-41aa-babd-2f2948e95e18 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.211462 Nov 12 02:26:45.142428 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 43/111] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:44 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:45.158155 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c289b394-28a7-4f06-90a7-545037cc35da tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:45.158885 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c289b394-28a7-4f06-90a7-545037cc35da tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:45.160593 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-500ae5d6-29ee-4d2e-b04d-348ec4d57b89 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:45.166999 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c289b394-28a7-4f06-90a7-545037cc35da tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:45.168231 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c289b394-28a7-4f06-90a7-545037cc35da tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:45.169060 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c289b394-28a7-4f06-90a7-545037cc35da tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:45.169495 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c289b394-28a7-4f06-90a7-545037cc35da tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:45.169607 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-500ae5d6-29ee-4d2e-b04d-348ec4d57b89 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1293 microversion: 2.1 time: 0.125603 Nov 12 02:26:45.170186 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 69/112] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:45 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1293 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:45.227939 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-c16ab23f-14de-468d-9039-2723ba3b4267 req-0c224ba0-f326-47ea-a6b4-b24d0d8c34e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44c025f0-3bb5-4ce5-944f-0f553ef80f8a", "tag": "827c9b0b-5bbb-48cc-9c27-94e0fb2378a2"}, {"name": "network-changed", "server_uuid": "7dc3ef58-e30c-44da-bef1-9678e3c7b14a", "tag": "838aaf11-0ed7-4529-b85a-74acc6e006ad"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:45.229711 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:26:45.229711 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:26:45.237673 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-c16ab23f-14de-468d-9039-2723ba3b4267 req-0c224ba0-f326-47ea-a6b4-b24d0d8c34e4 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:45.238347 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-c16ab23f-14de-468d-9039-2723ba3b4267 req-0c224ba0-f326-47ea-a6b4-b24d0d8c34e4 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:45.251846 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-c16ab23f-14de-468d-9039-2723ba3b4267 req-0c224ba0-f326-47ea-a6b4-b24d0d8c34e4 service nova] Creating event network-changed:827c9b0b-5bbb-48cc-9c27-94e0fb2378a2 for instance 44c025f0-3bb5-4ce5-944f-0f553ef80f8a on hv-cinder-80857 Nov 12 02:26:45.252606 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-c16ab23f-14de-468d-9039-2723ba3b4267 req-0c224ba0-f326-47ea-a6b4-b24d0d8c34e4 service nova] Creating event network-changed:838aaf11-0ed7-4529-b85a-74acc6e006ad for instance 7dc3ef58-e30c-44da-bef1-9678e3c7b14a on hv-cinder-80857 Nov 12 02:26:45.259890 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-c16ab23f-14de-468d-9039-2723ba3b4267 req-0c224ba0-f326-47ea-a6b4-b24d0d8c34e4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038233 Nov 12 02:26:45.261427 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 70/113] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:26:45 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:26:45.269844 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9d634728-af46-4c85-a6b4-ad0fd6267e1a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:45.270784 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9d634728-af46-4c85-a6b4-ad0fd6267e1a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:45.277044 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9d634728-af46-4c85-a6b4-ad0fd6267e1a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:45.277691 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9d634728-af46-4c85-a6b4-ad0fd6267e1a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:45.278866 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9d634728-af46-4c85-a6b4-ad0fd6267e1a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:45.279447 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9d634728-af46-4c85-a6b4-ad0fd6267e1a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:45.362396 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c289b394-28a7-4f06-90a7-545037cc35da tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:45.371708 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c289b394-28a7-4f06-90a7-545037cc35da tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.228146 Nov 12 02:26:45.372853 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 44/114] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:45 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:45.459111 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9d634728-af46-4c85-a6b4-ad0fd6267e1a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:45.461162 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-84c5d16f-98e5-494d-88fb-038edb6e55a9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:45.461983 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-84c5d16f-98e5-494d-88fb-038edb6e55a9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:45.468115 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84c5d16f-98e5-494d-88fb-038edb6e55a9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:45.468371 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9d634728-af46-4c85-a6b4-ad0fd6267e1a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:45.468722 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84c5d16f-98e5-494d-88fb-038edb6e55a9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:45.469496 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84c5d16f-98e5-494d-88fb-038edb6e55a9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:45.469930 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84c5d16f-98e5-494d-88fb-038edb6e55a9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:45.470481 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9d634728-af46-4c85-a6b4-ad0fd6267e1a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:45.471828 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9d634728-af46-4c85-a6b4-ad0fd6267e1a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.206011 Nov 12 02:26:45.483170 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 71/115] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:45 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:45.618703 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-84c5d16f-98e5-494d-88fb-038edb6e55a9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:45.626268 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-84c5d16f-98e5-494d-88fb-038edb6e55a9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.168979 Nov 12 02:26:45.626935 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 45/116] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:45 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:46.163513 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-44022378-f846-405d-820e-612342f7951d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:46.164940 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-44022378-f846-405d-820e-612342f7951d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:46.171257 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44022378-f846-405d-820e-612342f7951d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:46.171995 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44022378-f846-405d-820e-612342f7951d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:46.172777 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44022378-f846-405d-820e-612342f7951d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:46.173205 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44022378-f846-405d-820e-612342f7951d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:46.187596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dd7625dd-ef4c-4ed9-8c43-1975145a9c97 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:46.188190 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dd7625dd-ef4c-4ed9-8c43-1975145a9c97 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:46.194987 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd7625dd-ef4c-4ed9-8c43-1975145a9c97 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:46.195654 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd7625dd-ef4c-4ed9-8c43-1975145a9c97 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:46.196690 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd7625dd-ef4c-4ed9-8c43-1975145a9c97 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:46.197286 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd7625dd-ef4c-4ed9-8c43-1975145a9c97 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:46.348577 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dd7625dd-ef4c-4ed9-8c43-1975145a9c97 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:46.357001 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dd7625dd-ef4c-4ed9-8c43-1975145a9c97 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1293 microversion: 2.1 time: 0.173082 Nov 12 02:26:46.357643 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 46/117] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:46 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1293 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:46.390613 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d7893f48-c0c1-496b-b579-bcc1d09e549f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:46.391785 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d7893f48-c0c1-496b-b579-bcc1d09e549f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:46.402379 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7893f48-c0c1-496b-b579-bcc1d09e549f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:46.404533 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7893f48-c0c1-496b-b579-bcc1d09e549f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:46.405627 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7893f48-c0c1-496b-b579-bcc1d09e549f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:46.406197 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7893f48-c0c1-496b-b579-bcc1d09e549f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:46.739435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-44022378-f846-405d-820e-612342f7951d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:46.749023 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-44022378-f846-405d-820e-612342f7951d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.593163 Nov 12 02:26:46.750446 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 72/118] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:46 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:46.756296 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d62788d7-9ed7-4883-b7f8-4aa876b24fb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:46.758490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d62788d7-9ed7-4883-b7f8-4aa876b24fb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:46.764841 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d62788d7-9ed7-4883-b7f8-4aa876b24fb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:46.765713 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d62788d7-9ed7-4883-b7f8-4aa876b24fb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:46.766780 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d62788d7-9ed7-4883-b7f8-4aa876b24fb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:46.767429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d62788d7-9ed7-4883-b7f8-4aa876b24fb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:47.106701 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d7893f48-c0c1-496b-b579-bcc1d09e549f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:47.116980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d7893f48-c0c1-496b-b579-bcc1d09e549f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.731502 Nov 12 02:26:47.124846 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 47/119] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:46 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:47.129335 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1b681c2e-f7fd-4b2b-a960-797dd3763c30 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:47.130039 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1b681c2e-f7fd-4b2b-a960-797dd3763c30 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:47.137407 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b681c2e-f7fd-4b2b-a960-797dd3763c30 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:47.137743 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b681c2e-f7fd-4b2b-a960-797dd3763c30 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:47.138644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b681c2e-f7fd-4b2b-a960-797dd3763c30 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:47.141662 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1b681c2e-f7fd-4b2b-a960-797dd3763c30 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:47.523276 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d62788d7-9ed7-4883-b7f8-4aa876b24fb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:47.531610 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d62788d7-9ed7-4883-b7f8-4aa876b24fb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:47.533497 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d62788d7-9ed7-4883-b7f8-4aa876b24fb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:47.534685 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d62788d7-9ed7-4883-b7f8-4aa876b24fb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.782090 Nov 12 02:26:47.535241 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 73/120] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:46 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:47.540974 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-39873607-405a-485c-8376-3cf25c1ce5d7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:47.541702 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-39873607-405a-485c-8376-3cf25c1ce5d7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:47.549358 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-39873607-405a-485c-8376-3cf25c1ce5d7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:47.550136 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-39873607-405a-485c-8376-3cf25c1ce5d7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:47.551509 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-39873607-405a-485c-8376-3cf25c1ce5d7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:47.553536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-39873607-405a-485c-8376-3cf25c1ce5d7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:47.688450 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-39873607-405a-485c-8376-3cf25c1ce5d7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:47.698279 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-39873607-405a-485c-8376-3cf25c1ce5d7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1293 microversion: 2.1 time: 0.161601 Nov 12 02:26:47.699099 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 74/121] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:47 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1293 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:47.767934 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-44f84aaa-f9f2-4620-92ae-f505c66693a1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:47.768332 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-44f84aaa-f9f2-4620-92ae-f505c66693a1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:47.777451 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44f84aaa-f9f2-4620-92ae-f505c66693a1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:47.777921 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44f84aaa-f9f2-4620-92ae-f505c66693a1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:47.782595 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44f84aaa-f9f2-4620-92ae-f505c66693a1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:47.783268 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44f84aaa-f9f2-4620-92ae-f505c66693a1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:47.786656 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1b681c2e-f7fd-4b2b-a960-797dd3763c30 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:47.800661 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1b681c2e-f7fd-4b2b-a960-797dd3763c30 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.679501 Nov 12 02:26:47.803396 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 48/122] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:47 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:48.133020 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-44f84aaa-f9f2-4620-92ae-f505c66693a1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:48.136840 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-526b5bb1-717b-4959-92a6-dc6531abd46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:48.137783 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-526b5bb1-717b-4959-92a6-dc6531abd46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:48.149464 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-44f84aaa-f9f2-4620-92ae-f505c66693a1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.384674 Nov 12 02:26:48.149464 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 75/123] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:47 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:48.162610 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-526b5bb1-717b-4959-92a6-dc6531abd46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:48.164157 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-526b5bb1-717b-4959-92a6-dc6531abd46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:48.165813 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-526b5bb1-717b-4959-92a6-dc6531abd46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:48.166254 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-dbaaee5e-7105-420a-843d-7f12a967c968 req-851fb60d-88f9-411d-827f-07a0aa68a710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d16c68-a04c-4a32-a599-e202e6c64152", "tag": "6159a4de-08df-4c5b-afb6-bc1f4e2f213f"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:48.166946 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-526b5bb1-717b-4959-92a6-dc6531abd46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:48.167937 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:26:48.167937 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:26:48.185182 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-dbaaee5e-7105-420a-843d-7f12a967c968 req-851fb60d-88f9-411d-827f-07a0aa68a710 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:48.186070 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-dbaaee5e-7105-420a-843d-7f12a967c968 req-851fb60d-88f9-411d-827f-07a0aa68a710 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:48.200454 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-dbaaee5e-7105-420a-843d-7f12a967c968 req-851fb60d-88f9-411d-827f-07a0aa68a710 service nova] Creating event network-changed:6159a4de-08df-4c5b-afb6-bc1f4e2f213f for instance 26d16c68-a04c-4a32-a599-e202e6c64152 on hv-cinder-80857 Nov 12 02:26:48.205686 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-dbaaee5e-7105-420a-843d-7f12a967c968 req-851fb60d-88f9-411d-827f-07a0aa68a710 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043753 Nov 12 02:26:48.206597 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 76/124] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:26:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:48.341716 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-526b5bb1-717b-4959-92a6-dc6531abd46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:48.353184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-526b5bb1-717b-4959-92a6-dc6531abd46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.221248 Nov 12 02:26:48.358800 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 49/125] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:48 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:48.557524 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-49ce56cc-55bb-45ec-9e2f-0a60b7761ca7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:48.558373 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-49ce56cc-55bb-45ec-9e2f-0a60b7761ca7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:48.564748 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-49ce56cc-55bb-45ec-9e2f-0a60b7761ca7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:48.565183 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-49ce56cc-55bb-45ec-9e2f-0a60b7761ca7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:48.565944 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-49ce56cc-55bb-45ec-9e2f-0a60b7761ca7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:48.566366 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-49ce56cc-55bb-45ec-9e2f-0a60b7761ca7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:48.704508 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-49ce56cc-55bb-45ec-9e2f-0a60b7761ca7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:48.712578 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-49ce56cc-55bb-45ec-9e2f-0a60b7761ca7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:48.714055 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-49ce56cc-55bb-45ec-9e2f-0a60b7761ca7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:48.715172 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-49ce56cc-55bb-45ec-9e2f-0a60b7761ca7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.161742 Nov 12 02:26:48.715680 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f1212ff3-9d07-4981-ab0a-ac619885571d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:48.716113 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 77/126] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:48 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:26:48.716292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f1212ff3-9d07-4981-ab0a-ac619885571d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:48.722393 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1212ff3-9d07-4981-ab0a-ac619885571d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:48.722857 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1212ff3-9d07-4981-ab0a-ac619885571d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:48.723645 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1212ff3-9d07-4981-ab0a-ac619885571d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:48.724105 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1212ff3-9d07-4981-ab0a-ac619885571d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:48.818927 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-74098679-c14a-4a9b-8863-79f8aaef8f95 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:48.819530 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-74098679-c14a-4a9b-8863-79f8aaef8f95 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:48.825530 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-74098679-c14a-4a9b-8863-79f8aaef8f95 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:48.826045 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-74098679-c14a-4a9b-8863-79f8aaef8f95 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:48.826917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-74098679-c14a-4a9b-8863-79f8aaef8f95 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:48.827406 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-74098679-c14a-4a9b-8863-79f8aaef8f95 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:48.862650 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f1212ff3-9d07-4981-ab0a-ac619885571d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:48.872524 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f1212ff3-9d07-4981-ab0a-ac619885571d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.160448 Nov 12 02:26:48.873370 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 50/127] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:48 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:48.969217 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-74098679-c14a-4a9b-8863-79f8aaef8f95 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:48.976945 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-74098679-c14a-4a9b-8863-79f8aaef8f95 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.162059 Nov 12 02:26:48.977521 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 78/128] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:48 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:49.165539 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-94c9a104-7430-4097-8ff6-2b56a6be2b48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:49.166156 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-94c9a104-7430-4097-8ff6-2b56a6be2b48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:49.172767 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-94c9a104-7430-4097-8ff6-2b56a6be2b48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:49.173227 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-94c9a104-7430-4097-8ff6-2b56a6be2b48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:49.174047 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-94c9a104-7430-4097-8ff6-2b56a6be2b48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:49.174519 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-94c9a104-7430-4097-8ff6-2b56a6be2b48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:49.331024 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-94c9a104-7430-4097-8ff6-2b56a6be2b48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:49.338434 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-94c9a104-7430-4097-8ff6-2b56a6be2b48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.177026 Nov 12 02:26:49.339275 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 51/129] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:49 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:49.370423 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6ca8e923-ad30-49fd-917e-f2105bbe9c22 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:49.371140 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6ca8e923-ad30-49fd-917e-f2105bbe9c22 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:49.377483 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ca8e923-ad30-49fd-917e-f2105bbe9c22 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:49.377924 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ca8e923-ad30-49fd-917e-f2105bbe9c22 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:49.378713 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ca8e923-ad30-49fd-917e-f2105bbe9c22 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:49.379141 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ca8e923-ad30-49fd-917e-f2105bbe9c22 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:49.526605 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6ca8e923-ad30-49fd-917e-f2105bbe9c22 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:49.535325 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6ca8e923-ad30-49fd-917e-f2105bbe9c22 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.168410 Nov 12 02:26:49.536261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 79/130] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:49 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:49.734684 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bf2e099c-cd6b-470a-8bc6-6dc9473258ec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:49.735311 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bf2e099c-cd6b-470a-8bc6-6dc9473258ec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:49.741465 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf2e099c-cd6b-470a-8bc6-6dc9473258ec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:49.742067 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf2e099c-cd6b-470a-8bc6-6dc9473258ec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:49.743214 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf2e099c-cd6b-470a-8bc6-6dc9473258ec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:49.746730 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf2e099c-cd6b-470a-8bc6-6dc9473258ec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:49.883741 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bf2e099c-cd6b-470a-8bc6-6dc9473258ec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:49.889596 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d19366d8-8f72-439f-b6a2-a98c86e677f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:49.890201 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d19366d8-8f72-439f-b6a2-a98c86e677f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:49.892212 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bf2e099c-cd6b-470a-8bc6-6dc9473258ec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:49.893703 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bf2e099c-cd6b-470a-8bc6-6dc9473258ec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:49.894833 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bf2e099c-cd6b-470a-8bc6-6dc9473258ec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.164171 Nov 12 02:26:49.895397 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 52/131] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:49 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:49.897251 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d19366d8-8f72-439f-b6a2-a98c86e677f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:49.897690 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d19366d8-8f72-439f-b6a2-a98c86e677f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:49.898629 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d19366d8-8f72-439f-b6a2-a98c86e677f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:49.899097 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d19366d8-8f72-439f-b6a2-a98c86e677f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:49.993576 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-73cf8eaa-da6b-4c65-8f20-6bd0d741d882 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:49.994293 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-73cf8eaa-da6b-4c65-8f20-6bd0d741d882 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:50.001106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73cf8eaa-da6b-4c65-8f20-6bd0d741d882 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:50.001637 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73cf8eaa-da6b-4c65-8f20-6bd0d741d882 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:50.002484 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73cf8eaa-da6b-4c65-8f20-6bd0d741d882 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:50.003309 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73cf8eaa-da6b-4c65-8f20-6bd0d741d882 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:50.036915 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d19366d8-8f72-439f-b6a2-a98c86e677f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:50.044167 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d19366d8-8f72-439f-b6a2-a98c86e677f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.158155 Nov 12 02:26:50.044739 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 80/132] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:49 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:50.141993 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-73cf8eaa-da6b-4c65-8f20-6bd0d741d882 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:50.150329 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-73cf8eaa-da6b-4c65-8f20-6bd0d741d882 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.160626 Nov 12 02:26:50.150944 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 53/133] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:49 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:50.354654 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-de000b46-aaa4-4258-a4fd-581d114591ca tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:50.355287 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-de000b46-aaa4-4258-a4fd-581d114591ca tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:50.361133 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-de000b46-aaa4-4258-a4fd-581d114591ca tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:50.361589 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-de000b46-aaa4-4258-a4fd-581d114591ca tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:50.362371 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-de000b46-aaa4-4258-a4fd-581d114591ca tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:50.362841 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-de000b46-aaa4-4258-a4fd-581d114591ca tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:50.502586 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-de000b46-aaa4-4258-a4fd-581d114591ca tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:50.510406 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-de000b46-aaa4-4258-a4fd-581d114591ca tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.159421 Nov 12 02:26:50.511166 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 81/134] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:50 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:50.553464 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e8cdc31d-3aff-40cd-b215-6f0db9900606 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:50.554094 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e8cdc31d-3aff-40cd-b215-6f0db9900606 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:50.569580 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8cdc31d-3aff-40cd-b215-6f0db9900606 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:50.569995 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8cdc31d-3aff-40cd-b215-6f0db9900606 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:50.570533 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8cdc31d-3aff-40cd-b215-6f0db9900606 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:50.570999 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8cdc31d-3aff-40cd-b215-6f0db9900606 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:50.893117 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e8cdc31d-3aff-40cd-b215-6f0db9900606 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:50.909839 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e8cdc31d-3aff-40cd-b215-6f0db9900606 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.360396 Nov 12 02:26:50.913656 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d6461970-ad0e-46e9-b9e4-5d0c8727ea75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:50.914864 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d6461970-ad0e-46e9-b9e4-5d0c8727ea75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:50.921822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d6461970-ad0e-46e9-b9e4-5d0c8727ea75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:50.931519 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 54/135] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:50 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:50.932928 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d6461970-ad0e-46e9-b9e4-5d0c8727ea75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:50.933934 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d6461970-ad0e-46e9-b9e4-5d0c8727ea75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:50.934522 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d6461970-ad0e-46e9-b9e4-5d0c8727ea75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:51.061242 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-feaef0dc-b09b-4522-9f0f-db68f85ee6fb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:51.062057 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-feaef0dc-b09b-4522-9f0f-db68f85ee6fb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:51.068723 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-feaef0dc-b09b-4522-9f0f-db68f85ee6fb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:51.069307 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-feaef0dc-b09b-4522-9f0f-db68f85ee6fb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:51.070293 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-feaef0dc-b09b-4522-9f0f-db68f85ee6fb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:51.070830 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-feaef0dc-b09b-4522-9f0f-db68f85ee6fb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:51.774434 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d6461970-ad0e-46e9-b9e4-5d0c8727ea75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:51.793216 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d6461970-ad0e-46e9-b9e4-5d0c8727ea75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:51.797136 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d6461970-ad0e-46e9-b9e4-5d0c8727ea75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:51.799967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d6461970-ad0e-46e9-b9e4-5d0c8727ea75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.890376 Nov 12 02:26:51.801821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 82/136] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:50 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:51.808206 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-00a70af6-94bd-4e5c-a8d7-0007c45dff9e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:51.809213 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-00a70af6-94bd-4e5c-a8d7-0007c45dff9e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:51.816149 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-00a70af6-94bd-4e5c-a8d7-0007c45dff9e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:51.816734 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-00a70af6-94bd-4e5c-a8d7-0007c45dff9e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:51.817611 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-00a70af6-94bd-4e5c-a8d7-0007c45dff9e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:51.818357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-00a70af6-94bd-4e5c-a8d7-0007c45dff9e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:51.867085 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-feaef0dc-b09b-4522-9f0f-db68f85ee6fb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:51.875721 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-feaef0dc-b09b-4522-9f0f-db68f85ee6fb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.818006 Nov 12 02:26:51.876600 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 55/137] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:51 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:51.885352 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-54239fb3-d87e-4b53-b683-7b4e9e24aac2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:51.886321 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-54239fb3-d87e-4b53-b683-7b4e9e24aac2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:51.892719 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-54239fb3-d87e-4b53-b683-7b4e9e24aac2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:51.893727 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-54239fb3-d87e-4b53-b683-7b4e9e24aac2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:51.895193 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-54239fb3-d87e-4b53-b683-7b4e9e24aac2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:51.895635 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-54239fb3-d87e-4b53-b683-7b4e9e24aac2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:52.534335 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-00a70af6-94bd-4e5c-a8d7-0007c45dff9e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:52.544124 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-54239fb3-d87e-4b53-b683-7b4e9e24aac2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:52.550630 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-00a70af6-94bd-4e5c-a8d7-0007c45dff9e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.736665 Nov 12 02:26:52.553078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 83/138] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:51 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:52.560760 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-54239fb3-d87e-4b53-b683-7b4e9e24aac2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.681913 Nov 12 02:26:52.566112 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 56/139] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:51 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:52.574992 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d1ac6a75-2cf1-4739-8a74-e7e93e0ca169 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:52.574992 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d1ac6a75-2cf1-4739-8a74-e7e93e0ca169 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:52.576822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a75-2cf1-4739-8a74-e7e93e0ca169 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:52.577466 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a75-2cf1-4739-8a74-e7e93e0ca169 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:52.578352 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a75-2cf1-4739-8a74-e7e93e0ca169 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:52.579070 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1ac6a75-2cf1-4739-8a74-e7e93e0ca169 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:52.818132 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b2cdd974-2951-4637-9edb-c2dc9ab56601 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:52.818732 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b2cdd974-2951-4637-9edb-c2dc9ab56601 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:52.825694 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b2cdd974-2951-4637-9edb-c2dc9ab56601 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:52.826170 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b2cdd974-2951-4637-9edb-c2dc9ab56601 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:52.826994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b2cdd974-2951-4637-9edb-c2dc9ab56601 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:52.827431 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b2cdd974-2951-4637-9edb-c2dc9ab56601 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:52.896224 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d1ac6a75-2cf1-4739-8a74-e7e93e0ca169 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:52.908110 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d1ac6a75-2cf1-4739-8a74-e7e93e0ca169 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.350069 Nov 12 02:26:52.909533 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 84/140] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:52 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:52.915964 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-61b37b82-fa5a-493e-92b4-7b3aab0651cc req-ac004526-83f7-4812-b187-3b16ab0718c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1ce3bd-1739-49be-ab2e-e81c1026ae30", "tag": "2c2246ad-0135-4e41-9bee-c87015e386f7"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:26:52.917924 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:26:52.917924 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:26:52.928099 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-61b37b82-fa5a-493e-92b4-7b3aab0651cc req-ac004526-83f7-4812-b187-3b16ab0718c4 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:52.928948 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-61b37b82-fa5a-493e-92b4-7b3aab0651cc req-ac004526-83f7-4812-b187-3b16ab0718c4 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:52.943900 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-61b37b82-fa5a-493e-92b4-7b3aab0651cc req-ac004526-83f7-4812-b187-3b16ab0718c4 service nova] Creating event network-changed:2c2246ad-0135-4e41-9bee-c87015e386f7 for instance 5c1ce3bd-1739-49be-ab2e-e81c1026ae30 on hv-cinder-80857 Nov 12 02:26:52.950566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-61b37b82-fa5a-493e-92b4-7b3aab0651cc req-ac004526-83f7-4812-b187-3b16ab0718c4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038874 Nov 12 02:26:52.951156 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 85/141] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:26:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:26:52.956380 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f64b44a5-ccbc-41fc-89e4-723bd2760194 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:52.957174 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f64b44a5-ccbc-41fc-89e4-723bd2760194 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:52.966490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f64b44a5-ccbc-41fc-89e4-723bd2760194 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:52.966490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f64b44a5-ccbc-41fc-89e4-723bd2760194 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:52.966490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f64b44a5-ccbc-41fc-89e4-723bd2760194 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:52.966490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f64b44a5-ccbc-41fc-89e4-723bd2760194 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:53.140239 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b2cdd974-2951-4637-9edb-c2dc9ab56601 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:53.162190 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b2cdd974-2951-4637-9edb-c2dc9ab56601 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:53.164354 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b2cdd974-2951-4637-9edb-c2dc9ab56601 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:53.165968 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b2cdd974-2951-4637-9edb-c2dc9ab56601 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.351500 Nov 12 02:26:53.166551 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 57/142] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:52 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:26:53.255050 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f64b44a5-ccbc-41fc-89e4-723bd2760194 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:53.265116 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f64b44a5-ccbc-41fc-89e4-723bd2760194 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.312345 Nov 12 02:26:53.265743 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 86/143] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:52 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:53.570318 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ac887250-7a78-4e6a-8119-b73af13d4884 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:53.571158 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ac887250-7a78-4e6a-8119-b73af13d4884 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:53.578817 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac887250-7a78-4e6a-8119-b73af13d4884 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:53.578817 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac887250-7a78-4e6a-8119-b73af13d4884 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:53.578817 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac887250-7a78-4e6a-8119-b73af13d4884 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:53.579399 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac887250-7a78-4e6a-8119-b73af13d4884 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:53.585665 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8c74127d-fdc9-4968-ad9b-5115c641663f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:53.586295 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8c74127d-fdc9-4968-ad9b-5115c641663f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:53.593299 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8c74127d-fdc9-4968-ad9b-5115c641663f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:53.593754 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8c74127d-fdc9-4968-ad9b-5115c641663f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:53.595274 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8c74127d-fdc9-4968-ad9b-5115c641663f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:53.596265 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8c74127d-fdc9-4968-ad9b-5115c641663f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:54.138892 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8c74127d-fdc9-4968-ad9b-5115c641663f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:54.150112 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8c74127d-fdc9-4968-ad9b-5115c641663f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.569295 Nov 12 02:26:54.151031 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 87/144] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:53 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:54.155546 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ac887250-7a78-4e6a-8119-b73af13d4884 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:54.161118 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1806f21f-c0a4-4e0c-8913-12320596ccbe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:54.162566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1806f21f-c0a4-4e0c-8913-12320596ccbe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:54.164483 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ac887250-7a78-4e6a-8119-b73af13d4884 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.598805 Nov 12 02:26:54.165231 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 58/145] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:53 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:54.169809 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1806f21f-c0a4-4e0c-8913-12320596ccbe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:54.170407 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1806f21f-c0a4-4e0c-8913-12320596ccbe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:54.171241 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1806f21f-c0a4-4e0c-8913-12320596ccbe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:54.171675 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1806f21f-c0a4-4e0c-8913-12320596ccbe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:54.184761 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3aaf786f-bf48-4336-a8e8-56ce3786fa5e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:54.185532 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3aaf786f-bf48-4336-a8e8-56ce3786fa5e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:54.192091 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3aaf786f-bf48-4336-a8e8-56ce3786fa5e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:54.192541 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3aaf786f-bf48-4336-a8e8-56ce3786fa5e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:54.193933 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3aaf786f-bf48-4336-a8e8-56ce3786fa5e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:54.194365 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3aaf786f-bf48-4336-a8e8-56ce3786fa5e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:54.396666 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1806f21f-c0a4-4e0c-8913-12320596ccbe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:54.400306 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3aaf786f-bf48-4336-a8e8-56ce3786fa5e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:54.404911 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1806f21f-c0a4-4e0c-8913-12320596ccbe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.252661 Nov 12 02:26:54.405561 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 88/146] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:54 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:54.409881 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3aaf786f-bf48-4336-a8e8-56ce3786fa5e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:54.410894 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ae8bbb7d-49c3-4c16-bcdd-d5b2d9611fca tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:54.412253 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ae8bbb7d-49c3-4c16-bcdd-d5b2d9611fca tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:54.412784 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3aaf786f-bf48-4336-a8e8-56ce3786fa5e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:54.414791 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3aaf786f-bf48-4336-a8e8-56ce3786fa5e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.233843 Nov 12 02:26:54.415922 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 59/147] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:54 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:26:54.420097 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ae8bbb7d-49c3-4c16-bcdd-d5b2d9611fca tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:54.420378 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ae8bbb7d-49c3-4c16-bcdd-d5b2d9611fca tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:54.421181 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ae8bbb7d-49c3-4c16-bcdd-d5b2d9611fca tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:54.421888 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ae8bbb7d-49c3-4c16-bcdd-d5b2d9611fca tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:54.570295 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ae8bbb7d-49c3-4c16-bcdd-d5b2d9611fca tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:54.577917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ae8bbb7d-49c3-4c16-bcdd-d5b2d9611fca tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.171282 Nov 12 02:26:54.578701 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 89/148] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:54 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:55.166225 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-638191b5-8a81-43e5-863d-86defcaa7de3 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:55.166882 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-638191b5-8a81-43e5-863d-86defcaa7de3 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:55.172781 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-638191b5-8a81-43e5-863d-86defcaa7de3 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:55.173227 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-638191b5-8a81-43e5-863d-86defcaa7de3 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:55.174033 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-638191b5-8a81-43e5-863d-86defcaa7de3 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:55.174489 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-638191b5-8a81-43e5-863d-86defcaa7de3 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:55.181316 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-710f763e-0970-4ee0-b846-30c7e59833a7 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:55.181818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-710f763e-0970-4ee0-b846-30c7e59833a7 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:55.188947 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-710f763e-0970-4ee0-b846-30c7e59833a7 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:55.189609 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-710f763e-0970-4ee0-b846-30c7e59833a7 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:55.190544 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-710f763e-0970-4ee0-b846-30c7e59833a7 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:55.191149 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-710f763e-0970-4ee0-b846-30c7e59833a7 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:55.387727 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-638191b5-8a81-43e5-863d-86defcaa7de3 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:55.396183 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-638191b5-8a81-43e5-863d-86defcaa7de3 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.233036 Nov 12 02:26:55.404999 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 60/149] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:55 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:55.407208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-710f763e-0970-4ee0-b846-30c7e59833a7 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:55.415575 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-710f763e-0970-4ee0-b846-30c7e59833a7 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.238120 Nov 12 02:26:55.416456 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 90/150] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:55 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:55.421244 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d823a7b5-aedf-4514-89b4-d83266699036 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:55.421858 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d823a7b5-aedf-4514-89b4-d83266699036 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:55.428450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d823a7b5-aedf-4514-89b4-d83266699036 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:55.428891 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d823a7b5-aedf-4514-89b4-d83266699036 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:55.429674 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d823a7b5-aedf-4514-89b4-d83266699036 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:55.430106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d823a7b5-aedf-4514-89b4-d83266699036 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:55.439042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d6f3d6ee-da25-48ae-9345-39a486266fd7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:55.439542 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d6f3d6ee-da25-48ae-9345-39a486266fd7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:55.445822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d6f3d6ee-da25-48ae-9345-39a486266fd7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:55.446401 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d6f3d6ee-da25-48ae-9345-39a486266fd7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:55.447397 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d6f3d6ee-da25-48ae-9345-39a486266fd7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:55.447820 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d6f3d6ee-da25-48ae-9345-39a486266fd7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:55.657258 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d6f3d6ee-da25-48ae-9345-39a486266fd7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:55.657394 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d823a7b5-aedf-4514-89b4-d83266699036 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:55.662559 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d823a7b5-aedf-4514-89b4-d83266699036 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.244396 Nov 12 02:26:55.663275 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 61/151] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:55 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:55.664584 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d6f3d6ee-da25-48ae-9345-39a486266fd7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:55.666077 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d6f3d6ee-da25-48ae-9345-39a486266fd7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:55.667218 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d6f3d6ee-da25-48ae-9345-39a486266fd7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.232820 Nov 12 02:26:55.668239 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b751c5c9-78d8-41c5-a193-61fc1ced9552 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:55.668910 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b751c5c9-78d8-41c5-a193-61fc1ced9552 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:55.673846 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 91/152] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:55 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:26:55.676502 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b751c5c9-78d8-41c5-a193-61fc1ced9552 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:55.676502 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b751c5c9-78d8-41c5-a193-61fc1ced9552 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:55.676502 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b751c5c9-78d8-41c5-a193-61fc1ced9552 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:55.676767 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b751c5c9-78d8-41c5-a193-61fc1ced9552 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:55.820254 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b751c5c9-78d8-41c5-a193-61fc1ced9552 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:55.827797 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b751c5c9-78d8-41c5-a193-61fc1ced9552 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.163229 Nov 12 02:26:55.828384 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 62/153] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:55 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:56.412706 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f6852230-854c-4917-99f1-200f60d50a63 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:56.413318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f6852230-854c-4917-99f1-200f60d50a63 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:56.419244 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f6852230-854c-4917-99f1-200f60d50a63 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:56.419852 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f6852230-854c-4917-99f1-200f60d50a63 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:56.420496 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f6852230-854c-4917-99f1-200f60d50a63 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:56.420935 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f6852230-854c-4917-99f1-200f60d50a63 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:56.434140 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f4e27d09-12f0-4103-af57-ede20e5dafd6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:56.434819 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f4e27d09-12f0-4103-af57-ede20e5dafd6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:56.453394 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f4e27d09-12f0-4103-af57-ede20e5dafd6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:56.453804 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f4e27d09-12f0-4103-af57-ede20e5dafd6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:56.454485 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f4e27d09-12f0-4103-af57-ede20e5dafd6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:56.454945 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f4e27d09-12f0-4103-af57-ede20e5dafd6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:56.654937 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f6852230-854c-4917-99f1-200f60d50a63 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:56.663004 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f6852230-854c-4917-99f1-200f60d50a63 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.253870 Nov 12 02:26:56.663570 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f4e27d09-12f0-4103-af57-ede20e5dafd6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:56.663705 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 92/154] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:56 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:56.671795 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f4e27d09-12f0-4103-af57-ede20e5dafd6 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.241290 Nov 12 02:26:56.676071 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 63/155] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:56 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:56.682612 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7810cfc4-d75a-4589-baa2-c5831168696c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:56.683398 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7810cfc4-d75a-4589-baa2-c5831168696c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:56.686306 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-578fffb2-134d-4fb9-bcc5-187a26c5b926 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:56.687185 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-578fffb2-134d-4fb9-bcc5-187a26c5b926 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:56.690967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7810cfc4-d75a-4589-baa2-c5831168696c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:56.691418 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7810cfc4-d75a-4589-baa2-c5831168696c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:56.692207 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7810cfc4-d75a-4589-baa2-c5831168696c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:56.692638 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7810cfc4-d75a-4589-baa2-c5831168696c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:56.697993 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-578fffb2-134d-4fb9-bcc5-187a26c5b926 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:56.699421 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-578fffb2-134d-4fb9-bcc5-187a26c5b926 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:56.700716 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-578fffb2-134d-4fb9-bcc5-187a26c5b926 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:56.701338 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-578fffb2-134d-4fb9-bcc5-187a26c5b926 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:56.908429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7810cfc4-d75a-4589-baa2-c5831168696c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:56.916783 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7810cfc4-d75a-4589-baa2-c5831168696c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.239113 Nov 12 02:26:56.917527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 93/156] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:56 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:56.921956 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ffb897b2-1eec-4042-b523-eb816ce159f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:56.922736 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ffb897b2-1eec-4042-b523-eb816ce159f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:56.922918 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-578fffb2-134d-4fb9-bcc5-187a26c5b926 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:56.931512 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ffb897b2-1eec-4042-b523-eb816ce159f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:56.931597 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ffb897b2-1eec-4042-b523-eb816ce159f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:56.932357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ffb897b2-1eec-4042-b523-eb816ce159f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:56.933272 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ffb897b2-1eec-4042-b523-eb816ce159f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:56.939994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-578fffb2-134d-4fb9-bcc5-187a26c5b926 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:56.942175 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-578fffb2-134d-4fb9-bcc5-187a26c5b926 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:56.944092 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-578fffb2-134d-4fb9-bcc5-187a26c5b926 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.261792 Nov 12 02:26:56.944658 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 64/157] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:56 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:57.078500 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ffb897b2-1eec-4042-b523-eb816ce159f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:57.086621 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ffb897b2-1eec-4042-b523-eb816ce159f2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.168095 Nov 12 02:26:57.087391 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 94/158] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:56 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:57.680199 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d7734ee7-0e32-4df3-85bb-797d3429face tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:57.680794 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d7734ee7-0e32-4df3-85bb-797d3429face tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:57.686975 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7734ee7-0e32-4df3-85bb-797d3429face tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:57.687677 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7734ee7-0e32-4df3-85bb-797d3429face tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:57.688637 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7734ee7-0e32-4df3-85bb-797d3429face tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:57.689031 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5fc009b3-9bdf-4e12-b836-659612253689 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:57.689478 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7734ee7-0e32-4df3-85bb-797d3429face tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:57.689656 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5fc009b3-9bdf-4e12-b836-659612253689 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:57.696217 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5fc009b3-9bdf-4e12-b836-659612253689 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:57.696665 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5fc009b3-9bdf-4e12-b836-659612253689 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:57.697444 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5fc009b3-9bdf-4e12-b836-659612253689 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:57.697875 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5fc009b3-9bdf-4e12-b836-659612253689 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:58.038189 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5fc009b3-9bdf-4e12-b836-659612253689 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:58.043486 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d7734ee7-0e32-4df3-85bb-797d3429face tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:58.046226 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5fc009b3-9bdf-4e12-b836-659612253689 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.360691 Nov 12 02:26:58.046911 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 95/159] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:57 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:26:58.056207 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d7734ee7-0e32-4df3-85bb-797d3429face tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.375398 Nov 12 02:26:58.056207 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 65/160] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:57 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:58.057015 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b4f16495-2dc1-44ad-a5cb-842fc19de46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:58.057615 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b4f16495-2dc1-44ad-a5cb-842fc19de46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:58.061409 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f0ab3676-8d6e-4c50-b024-1fd4fbeeb441 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:58.062080 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f0ab3676-8d6e-4c50-b024-1fd4fbeeb441 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:58.063433 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4f16495-2dc1-44ad-a5cb-842fc19de46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:58.063879 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4f16495-2dc1-44ad-a5cb-842fc19de46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:58.064643 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4f16495-2dc1-44ad-a5cb-842fc19de46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:58.065238 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4f16495-2dc1-44ad-a5cb-842fc19de46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:58.068047 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f0ab3676-8d6e-4c50-b024-1fd4fbeeb441 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:58.068555 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f0ab3676-8d6e-4c50-b024-1fd4fbeeb441 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:58.069580 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f0ab3676-8d6e-4c50-b024-1fd4fbeeb441 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:58.070001 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f0ab3676-8d6e-4c50-b024-1fd4fbeeb441 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:58.266504 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b4f16495-2dc1-44ad-a5cb-842fc19de46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:58.275288 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b4f16495-2dc1-44ad-a5cb-842fc19de46e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.221473 Nov 12 02:26:58.275910 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 66/161] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:58 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:58.276152 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f0ab3676-8d6e-4c50-b024-1fd4fbeeb441 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:58.280365 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-26cf95ed-b70a-4c79-9659-2001f619f5ae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:58.280974 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-26cf95ed-b70a-4c79-9659-2001f619f5ae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:58.284529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f0ab3676-8d6e-4c50-b024-1fd4fbeeb441 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:58.285944 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f0ab3676-8d6e-4c50-b024-1fd4fbeeb441 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:58.287518 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26cf95ed-b70a-4c79-9659-2001f619f5ae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:58.287644 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f0ab3676-8d6e-4c50-b024-1fd4fbeeb441 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.230024 Nov 12 02:26:58.287970 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26cf95ed-b70a-4c79-9659-2001f619f5ae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:58.288129 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 96/162] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:58 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:58.288886 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26cf95ed-b70a-4c79-9659-2001f619f5ae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:58.289325 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26cf95ed-b70a-4c79-9659-2001f619f5ae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:58.432516 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-26cf95ed-b70a-4c79-9659-2001f619f5ae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:58.440005 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-26cf95ed-b70a-4c79-9659-2001f619f5ae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.163069 Nov 12 02:26:58.440578 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 67/163] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:58 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:59.068280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a57ba2a0-f371-4bca-9e84-8ec285bc8b40 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:59.068883 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a57ba2a0-f371-4bca-9e84-8ec285bc8b40 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:59.069818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4f138d67-42aa-4b83-84bf-3f5caa253245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:59.071026 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4f138d67-42aa-4b83-84bf-3f5caa253245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:59.078887 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a57ba2a0-f371-4bca-9e84-8ec285bc8b40 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:59.084140 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4f138d67-42aa-4b83-84bf-3f5caa253245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:59.084140 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4f138d67-42aa-4b83-84bf-3f5caa253245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:59.084140 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4f138d67-42aa-4b83-84bf-3f5caa253245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:59.085718 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4f138d67-42aa-4b83-84bf-3f5caa253245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:59.085886 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a57ba2a0-f371-4bca-9e84-8ec285bc8b40 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:59.085986 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a57ba2a0-f371-4bca-9e84-8ec285bc8b40 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:59.086348 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a57ba2a0-f371-4bca-9e84-8ec285bc8b40 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:59.343790 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4f138d67-42aa-4b83-84bf-3f5caa253245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:59.354857 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a57ba2a0-f371-4bca-9e84-8ec285bc8b40 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:59.355593 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4f138d67-42aa-4b83-84bf-3f5caa253245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.295293 Nov 12 02:26:59.357021 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 97/164] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:59 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:59.362381 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a57ba2a0-f371-4bca-9e84-8ec285bc8b40 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.298062 Nov 12 02:26:59.363495 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2f185568-cb5e-432c-81d1-c52a6297bb46 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:59.364340 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2f185568-cb5e-432c-81d1-c52a6297bb46 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:59.373194 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 68/165] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:59 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:59.373860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2f185568-cb5e-432c-81d1-c52a6297bb46 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:59.374499 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2f185568-cb5e-432c-81d1-c52a6297bb46 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:59.375496 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2f185568-cb5e-432c-81d1-c52a6297bb46 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:59.376135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2f185568-cb5e-432c-81d1-c52a6297bb46 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:59.378033 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-eb2ac64f-3657-4483-91b5-2aaff027f61e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:59.378786 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-eb2ac64f-3657-4483-91b5-2aaff027f61e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:59.385327 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eb2ac64f-3657-4483-91b5-2aaff027f61e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:59.386298 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eb2ac64f-3657-4483-91b5-2aaff027f61e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:59.387557 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eb2ac64f-3657-4483-91b5-2aaff027f61e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:59.388726 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eb2ac64f-3657-4483-91b5-2aaff027f61e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:59.633978 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-2f185568-cb5e-432c-81d1-c52a6297bb46 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:59.643273 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2f185568-cb5e-432c-81d1-c52a6297bb46 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.284221 Nov 12 02:26:59.644282 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 98/166] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:59 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:26:59.649577 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c50c90a9-e034-4784-a57d-4e030f761645 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:26:59.650534 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c50c90a9-e034-4784-a57d-4e030f761645 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:26:59.658540 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c50c90a9-e034-4784-a57d-4e030f761645 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:59.666490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c50c90a9-e034-4784-a57d-4e030f761645 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:59.666490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c50c90a9-e034-4784-a57d-4e030f761645 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:26:59.666490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c50c90a9-e034-4784-a57d-4e030f761645 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:26:59.673153 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-eb2ac64f-3657-4483-91b5-2aaff027f61e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:59.683608 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-eb2ac64f-3657-4483-91b5-2aaff027f61e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:59.685147 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-eb2ac64f-3657-4483-91b5-2aaff027f61e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:59.686231 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-eb2ac64f-3657-4483-91b5-2aaff027f61e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.312002 Nov 12 02:26:59.694300 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 69/167] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:26:59 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:26:59.839155 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c50c90a9-e034-4784-a57d-4e030f761645 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:26:59.846463 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c50c90a9-e034-4784-a57d-4e030f761645 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.201019 Nov 12 02:26:59.847081 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 99/168] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:26:59 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:00.380656 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fed02c69-d36b-4a3f-b52b-54d63e93f131 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:00.381436 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fed02c69-d36b-4a3f-b52b-54d63e93f131 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:00.382498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8d7d5bf8-fef4-49d2-a3a8-df7ce1332f48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:00.383214 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8d7d5bf8-fef4-49d2-a3a8-df7ce1332f48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:00.389712 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fed02c69-d36b-4a3f-b52b-54d63e93f131 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:00.389952 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d7d5bf8-fef4-49d2-a3a8-df7ce1332f48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:00.390225 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d7d5bf8-fef4-49d2-a3a8-df7ce1332f48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:00.391121 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fed02c69-d36b-4a3f-b52b-54d63e93f131 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:00.391246 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d7d5bf8-fef4-49d2-a3a8-df7ce1332f48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:00.391680 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d7d5bf8-fef4-49d2-a3a8-df7ce1332f48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:00.392509 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fed02c69-d36b-4a3f-b52b-54d63e93f131 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:00.393616 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fed02c69-d36b-4a3f-b52b-54d63e93f131 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:00.622495 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8d7d5bf8-fef4-49d2-a3a8-df7ce1332f48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:00.631295 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8d7d5bf8-fef4-49d2-a3a8-df7ce1332f48 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.252608 Nov 12 02:27:00.641065 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 100/169] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:00 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:00.645323 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fed02c69-d36b-4a3f-b52b-54d63e93f131 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:00.652832 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fed02c69-d36b-4a3f-b52b-54d63e93f131 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.275725 Nov 12 02:27:00.653737 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 70/170] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:00 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:00.663661 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8e4485cd-7fdc-4e09-aff9-4d94b28422cd tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:00.664272 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8e4485cd-7fdc-4e09-aff9-4d94b28422cd tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:00.671956 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e4485cd-7fdc-4e09-aff9-4d94b28422cd tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:00.671956 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e4485cd-7fdc-4e09-aff9-4d94b28422cd tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:00.672826 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e4485cd-7fdc-4e09-aff9-4d94b28422cd tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:00.672906 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e4485cd-7fdc-4e09-aff9-4d94b28422cd tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:00.707015 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-26cc0fd2-337f-4744-a204-ce247d107741 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:00.707534 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-26cc0fd2-337f-4744-a204-ce247d107741 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:00.717249 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26cc0fd2-337f-4744-a204-ce247d107741 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:00.717682 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26cc0fd2-337f-4744-a204-ce247d107741 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:00.721407 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26cc0fd2-337f-4744-a204-ce247d107741 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:00.721855 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26cc0fd2-337f-4744-a204-ce247d107741 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:01.032886 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8e4485cd-7fdc-4e09-aff9-4d94b28422cd tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:01.053088 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8e4485cd-7fdc-4e09-aff9-4d94b28422cd tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.395262 Nov 12 02:27:01.062954 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 101/171] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:00 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:01.062954 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-12e2b007-6c7a-470b-9eab-a4a71f70d537 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:01.062954 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-12e2b007-6c7a-470b-9eab-a4a71f70d537 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:01.068722 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12e2b007-6c7a-470b-9eab-a4a71f70d537 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:01.069377 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12e2b007-6c7a-470b-9eab-a4a71f70d537 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:01.070363 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12e2b007-6c7a-470b-9eab-a4a71f70d537 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:01.071199 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12e2b007-6c7a-470b-9eab-a4a71f70d537 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:01.091393 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-26cc0fd2-337f-4744-a204-ce247d107741 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:01.109627 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-26cc0fd2-337f-4744-a204-ce247d107741 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:01.119640 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-26cc0fd2-337f-4744-a204-ce247d107741 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:01.122867 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-26cc0fd2-337f-4744-a204-ce247d107741 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.417983 Nov 12 02:27:01.124585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 71/172] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:00 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:01.302224 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-12e2b007-6c7a-470b-9eab-a4a71f70d537 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:01.311344 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-12e2b007-6c7a-470b-9eab-a4a71f70d537 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.254947 Nov 12 02:27:01.312346 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 102/173] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:01 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:01.649696 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7458daf4-0ff1-4564-8180-70858325abf5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:01.651559 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7458daf4-0ff1-4564-8180-70858325abf5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:01.657650 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7458daf4-0ff1-4564-8180-70858325abf5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:01.658519 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7458daf4-0ff1-4564-8180-70858325abf5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:01.659652 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7458daf4-0ff1-4564-8180-70858325abf5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:01.660156 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7458daf4-0ff1-4564-8180-70858325abf5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:01.670419 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-517e1ece-e584-4860-b5b2-3b505181558f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:01.671708 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-517e1ece-e584-4860-b5b2-3b505181558f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:01.678347 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-517e1ece-e584-4860-b5b2-3b505181558f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:01.679100 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-517e1ece-e584-4860-b5b2-3b505181558f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:01.680095 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-517e1ece-e584-4860-b5b2-3b505181558f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:01.680844 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-517e1ece-e584-4860-b5b2-3b505181558f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:01.899220 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-517e1ece-e584-4860-b5b2-3b505181558f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:01.906732 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-517e1ece-e584-4860-b5b2-3b505181558f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.239985 Nov 12 02:27:01.907316 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 103/174] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:01 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:01.909819 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7458daf4-0ff1-4564-8180-70858325abf5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:01.921011 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7458daf4-0ff1-4564-8180-70858325abf5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.276522 Nov 12 02:27:01.921764 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 72/175] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:01 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:02.070604 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e0a44883-cd80-4fae-b62c-5d3592f7a344 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:02.071259 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e0a44883-cd80-4fae-b62c-5d3592f7a344 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:02.079495 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e0a44883-cd80-4fae-b62c-5d3592f7a344 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:02.080334 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e0a44883-cd80-4fae-b62c-5d3592f7a344 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:02.081191 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e0a44883-cd80-4fae-b62c-5d3592f7a344 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:02.082128 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e0a44883-cd80-4fae-b62c-5d3592f7a344 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:02.142945 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b7fa552a-2c77-4ebb-8c6b-82ff52e69b5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:02.143873 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b7fa552a-2c77-4ebb-8c6b-82ff52e69b5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:02.153135 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7fa552a-2c77-4ebb-8c6b-82ff52e69b5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:02.153664 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7fa552a-2c77-4ebb-8c6b-82ff52e69b5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:02.154460 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7fa552a-2c77-4ebb-8c6b-82ff52e69b5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:02.154927 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7fa552a-2c77-4ebb-8c6b-82ff52e69b5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:02.304863 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e0a44883-cd80-4fae-b62c-5d3592f7a344 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:02.314132 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e0a44883-cd80-4fae-b62c-5d3592f7a344 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.247305 Nov 12 02:27:02.324659 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 104/176] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:02 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:02.330829 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-03fc44bc-5067-4658-9844-8356334b6c8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:02.331521 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-03fc44bc-5067-4658-9844-8356334b6c8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:02.337450 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-03fc44bc-5067-4658-9844-8356334b6c8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:02.337974 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-03fc44bc-5067-4658-9844-8356334b6c8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:02.339028 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-03fc44bc-5067-4658-9844-8356334b6c8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:02.339523 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-03fc44bc-5067-4658-9844-8356334b6c8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:02.356606 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b7fa552a-2c77-4ebb-8c6b-82ff52e69b5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:02.365325 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b7fa552a-2c77-4ebb-8c6b-82ff52e69b5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:02.367214 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b7fa552a-2c77-4ebb-8c6b-82ff52e69b5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:02.369136 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b7fa552a-2c77-4ebb-8c6b-82ff52e69b5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.229792 Nov 12 02:27:02.370153 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 73/177] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:02 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:02.507857 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-03fc44bc-5067-4658-9844-8356334b6c8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:02.517328 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-03fc44bc-5067-4658-9844-8356334b6c8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.189939 Nov 12 02:27:02.518485 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 105/178] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:02 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:02.927571 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5ac9021d-6094-416c-8467-0e1fed023f67 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:02.928953 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5ac9021d-6094-416c-8467-0e1fed023f67 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:02.942222 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a7db7a1f-5f4a-45c7-8336-98e17d03e63f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:02.943260 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ac9021d-6094-416c-8467-0e1fed023f67 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:02.944103 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ac9021d-6094-416c-8467-0e1fed023f67 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:02.944402 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a7db7a1f-5f4a-45c7-8336-98e17d03e63f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:02.945250 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ac9021d-6094-416c-8467-0e1fed023f67 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:02.945709 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ac9021d-6094-416c-8467-0e1fed023f67 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:02.952202 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a7db7a1f-5f4a-45c7-8336-98e17d03e63f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:02.953012 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a7db7a1f-5f4a-45c7-8336-98e17d03e63f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:02.954558 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a7db7a1f-5f4a-45c7-8336-98e17d03e63f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:02.955475 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a7db7a1f-5f4a-45c7-8336-98e17d03e63f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:03.172110 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a7db7a1f-5f4a-45c7-8336-98e17d03e63f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:03.175441 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5ac9021d-6094-416c-8467-0e1fed023f67 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:03.180024 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a7db7a1f-5f4a-45c7-8336-98e17d03e63f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.243217 Nov 12 02:27:03.181037 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 106/179] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:02 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:03.184986 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5ac9021d-6094-416c-8467-0e1fed023f67 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.263530 Nov 12 02:27:03.185715 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 74/180] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:02 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:03.333035 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-09968299-6755-41a0-a12e-1db8904f0c87 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:03.333035 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-09968299-6755-41a0-a12e-1db8904f0c87 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:03.339534 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-09968299-6755-41a0-a12e-1db8904f0c87 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:03.339987 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-09968299-6755-41a0-a12e-1db8904f0c87 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:03.340767 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-09968299-6755-41a0-a12e-1db8904f0c87 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:03.341202 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-09968299-6755-41a0-a12e-1db8904f0c87 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:03.387201 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e8191203-f08a-422c-80ad-7e7fcb31d351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:03.387809 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e8191203-f08a-422c-80ad-7e7fcb31d351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:03.393727 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8191203-f08a-422c-80ad-7e7fcb31d351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:03.394173 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8191203-f08a-422c-80ad-7e7fcb31d351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:03.394973 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8191203-f08a-422c-80ad-7e7fcb31d351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:03.395406 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e8191203-f08a-422c-80ad-7e7fcb31d351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:03.516265 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-09968299-6755-41a0-a12e-1db8904f0c87 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:03.527967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-09968299-6755-41a0-a12e-1db8904f0c87 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.199054 Nov 12 02:27:03.528762 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 107/181] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:03 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:03.542565 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b5c4db55-d76a-4776-a650-0c831698bcd9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:03.543206 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b5c4db55-d76a-4776-a650-0c831698bcd9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:03.549521 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b5c4db55-d76a-4776-a650-0c831698bcd9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:03.549908 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b5c4db55-d76a-4776-a650-0c831698bcd9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:03.550732 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b5c4db55-d76a-4776-a650-0c831698bcd9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:03.551163 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b5c4db55-d76a-4776-a650-0c831698bcd9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:03.579088 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e8191203-f08a-422c-80ad-7e7fcb31d351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:03.588490 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e8191203-f08a-422c-80ad-7e7fcb31d351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:03.590076 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e8191203-f08a-422c-80ad-7e7fcb31d351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:03.591468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e8191203-f08a-422c-80ad-7e7fcb31d351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.207690 Nov 12 02:27:03.592971 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 75/182] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:03 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:03.703593 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b5c4db55-d76a-4776-a650-0c831698bcd9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:03.713663 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b5c4db55-d76a-4776-a650-0c831698bcd9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.174723 Nov 12 02:27:03.723284 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 108/183] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:03 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:04.197371 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cee677ca-9096-4e17-9ae6-c1cbf44c1f7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:04.198024 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cee677ca-9096-4e17-9ae6-c1cbf44c1f7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:04.200836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-671ee713-de46-4acc-a8a3-bd69314d0e42 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:04.201447 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-671ee713-de46-4acc-a8a3-bd69314d0e42 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:04.203855 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cee677ca-9096-4e17-9ae6-c1cbf44c1f7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:04.204307 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cee677ca-9096-4e17-9ae6-c1cbf44c1f7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:04.205082 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cee677ca-9096-4e17-9ae6-c1cbf44c1f7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:04.205519 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cee677ca-9096-4e17-9ae6-c1cbf44c1f7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:04.207108 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-671ee713-de46-4acc-a8a3-bd69314d0e42 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:04.207557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-671ee713-de46-4acc-a8a3-bd69314d0e42 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:04.208939 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-671ee713-de46-4acc-a8a3-bd69314d0e42 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:04.209379 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-671ee713-de46-4acc-a8a3-bd69314d0e42 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:04.392192 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cee677ca-9096-4e17-9ae6-c1cbf44c1f7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:04.399712 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-671ee713-de46-4acc-a8a3-bd69314d0e42 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:04.399942 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cee677ca-9096-4e17-9ae6-c1cbf44c1f7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.206211 Nov 12 02:27:04.400518 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 76/184] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:04 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:04.407097 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-671ee713-de46-4acc-a8a3-bd69314d0e42 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.209858 Nov 12 02:27:04.407651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 109/185] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:04 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:04.545089 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e6995320-e789-4bd1-bb96-95f99048b6d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:04.545697 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e6995320-e789-4bd1-bb96-95f99048b6d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:04.551459 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e6995320-e789-4bd1-bb96-95f99048b6d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:04.552418 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e6995320-e789-4bd1-bb96-95f99048b6d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:04.553189 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e6995320-e789-4bd1-bb96-95f99048b6d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:04.553624 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e6995320-e789-4bd1-bb96-95f99048b6d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:04.616101 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-90d3b6ba-9672-4369-89da-6d73501a12b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:04.616817 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-90d3b6ba-9672-4369-89da-6d73501a12b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:04.632448 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-90d3b6ba-9672-4369-89da-6d73501a12b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:04.632888 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-90d3b6ba-9672-4369-89da-6d73501a12b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:04.633665 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-90d3b6ba-9672-4369-89da-6d73501a12b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:04.634089 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-90d3b6ba-9672-4369-89da-6d73501a12b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:04.717557 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e6995320-e789-4bd1-bb96-95f99048b6d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:04.725986 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e6995320-e789-4bd1-bb96-95f99048b6d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.184602 Nov 12 02:27:04.726559 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 77/186] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:04 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:04.736530 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-696a3e6c-5af8-4a38-ab1b-6a4068d40785 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:04.737139 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-696a3e6c-5af8-4a38-ab1b-6a4068d40785 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:04.743971 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-696a3e6c-5af8-4a38-ab1b-6a4068d40785 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:04.744545 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-696a3e6c-5af8-4a38-ab1b-6a4068d40785 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:04.745607 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-696a3e6c-5af8-4a38-ab1b-6a4068d40785 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:04.746050 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-696a3e6c-5af8-4a38-ab1b-6a4068d40785 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:04.795389 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-90d3b6ba-9672-4369-89da-6d73501a12b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:04.803736 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-90d3b6ba-9672-4369-89da-6d73501a12b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:04.805335 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-90d3b6ba-9672-4369-89da-6d73501a12b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:04.806506 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-90d3b6ba-9672-4369-89da-6d73501a12b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.194695 Nov 12 02:27:04.807189 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 110/187] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:04 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:04.882168 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-696a3e6c-5af8-4a38-ab1b-6a4068d40785 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:04.889372 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-696a3e6c-5af8-4a38-ab1b-6a4068d40785 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.161862 Nov 12 02:27:04.889928 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 78/188] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:04 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:05.415997 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0bc4f417-5c91-49fd-9262-b1c4465e3b13 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:05.416640 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0bc4f417-5c91-49fd-9262-b1c4465e3b13 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:05.422751 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0bc4f417-5c91-49fd-9262-b1c4465e3b13 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:05.423137 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0bc4f417-5c91-49fd-9262-b1c4465e3b13 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:05.423517 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dc171fe8-d728-4466-97ab-43abf3044637 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:05.424010 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0bc4f417-5c91-49fd-9262-b1c4465e3b13 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:05.424136 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dc171fe8-d728-4466-97ab-43abf3044637 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:05.424622 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0bc4f417-5c91-49fd-9262-b1c4465e3b13 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:05.430383 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc171fe8-d728-4466-97ab-43abf3044637 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:05.430874 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc171fe8-d728-4466-97ab-43abf3044637 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:05.431647 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc171fe8-d728-4466-97ab-43abf3044637 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:05.432080 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc171fe8-d728-4466-97ab-43abf3044637 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:05.614321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0bc4f417-5c91-49fd-9262-b1c4465e3b13 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:05.619504 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dc171fe8-d728-4466-97ab-43abf3044637 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:05.622339 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0bc4f417-5c91-49fd-9262-b1c4465e3b13 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.209935 Nov 12 02:27:05.622991 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 111/189] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:05 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:05.627137 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dc171fe8-d728-4466-97ab-43abf3044637 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.207331 Nov 12 02:27:05.627816 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 79/190] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:05 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:05.743171 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c30caec5-daaf-4f10-a1ae-333a675f71d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:05.743770 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c30caec5-daaf-4f10-a1ae-333a675f71d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:05.749617 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c30caec5-daaf-4f10-a1ae-333a675f71d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:05.750064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c30caec5-daaf-4f10-a1ae-333a675f71d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:05.750881 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c30caec5-daaf-4f10-a1ae-333a675f71d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:05.751310 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c30caec5-daaf-4f10-a1ae-333a675f71d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:05.824644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a0e1cd9a-d8b9-49f5-ad30-0fd52a809c41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:05.825164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a0e1cd9a-d8b9-49f5-ad30-0fd52a809c41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:05.831205 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a0e1cd9a-d8b9-49f5-ad30-0fd52a809c41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:05.831669 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a0e1cd9a-d8b9-49f5-ad30-0fd52a809c41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:05.832424 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a0e1cd9a-d8b9-49f5-ad30-0fd52a809c41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:05.832859 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a0e1cd9a-d8b9-49f5-ad30-0fd52a809c41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:05.906858 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c30caec5-daaf-4f10-a1ae-333a675f71d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:05.914378 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c30caec5-daaf-4f10-a1ae-333a675f71d9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.175720 Nov 12 02:27:05.914955 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 112/191] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:05 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:05.929248 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f2f7e1ec-b6fd-4e18-905a-edc6798ffa13 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:05.929848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f2f7e1ec-b6fd-4e18-905a-edc6798ffa13 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:05.935712 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f2f7e1ec-b6fd-4e18-905a-edc6798ffa13 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:05.936153 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f2f7e1ec-b6fd-4e18-905a-edc6798ffa13 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:05.936918 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f2f7e1ec-b6fd-4e18-905a-edc6798ffa13 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:05.937341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f2f7e1ec-b6fd-4e18-905a-edc6798ffa13 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:05.987442 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a0e1cd9a-d8b9-49f5-ad30-0fd52a809c41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:05.995524 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a0e1cd9a-d8b9-49f5-ad30-0fd52a809c41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:05.997015 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a0e1cd9a-d8b9-49f5-ad30-0fd52a809c41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:05.998120 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a0e1cd9a-d8b9-49f5-ad30-0fd52a809c41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.177529 Nov 12 02:27:05.998697 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 80/192] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:05 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:06.089656 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f2f7e1ec-b6fd-4e18-905a-edc6798ffa13 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:06.096640 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f2f7e1ec-b6fd-4e18-905a-edc6798ffa13 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.171537 Nov 12 02:27:06.097192 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 113/193] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:05 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:06.639485 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4e36d555-4283-4660-9650-6f36c761ea3d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:06.640049 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4e36d555-4283-4660-9650-6f36c761ea3d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:06.644988 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e048db7e-3870-427f-ad3b-0ba4bb17978c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:06.646226 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e048db7e-3870-427f-ad3b-0ba4bb17978c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:06.649812 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e36d555-4283-4660-9650-6f36c761ea3d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:06.650304 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e36d555-4283-4660-9650-6f36c761ea3d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:06.651277 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e36d555-4283-4660-9650-6f36c761ea3d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:06.651602 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e36d555-4283-4660-9650-6f36c761ea3d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:06.657258 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e048db7e-3870-427f-ad3b-0ba4bb17978c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:06.657709 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e048db7e-3870-427f-ad3b-0ba4bb17978c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:06.658498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e048db7e-3870-427f-ad3b-0ba4bb17978c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:06.658967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e048db7e-3870-427f-ad3b-0ba4bb17978c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:06.848117 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4e36d555-4283-4660-9650-6f36c761ea3d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:06.856849 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4e36d555-4283-4660-9650-6f36c761ea3d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.221091 Nov 12 02:27:06.856969 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e048db7e-3870-427f-ad3b-0ba4bb17978c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:06.857609 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 81/194] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:06 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:06.864063 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e048db7e-3870-427f-ad3b-0ba4bb17978c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.222666 Nov 12 02:27:06.865149 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 114/195] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:06 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:06.931228 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4c5667da-2df4-4506-af87-dea85289b51d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:06.931832 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4c5667da-2df4-4506-af87-dea85289b51d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:06.939667 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c5667da-2df4-4506-af87-dea85289b51d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:06.940112 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c5667da-2df4-4506-af87-dea85289b51d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:06.943520 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c5667da-2df4-4506-af87-dea85289b51d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:06.944324 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c5667da-2df4-4506-af87-dea85289b51d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:07.018425 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d62d911a-5ece-4cca-b1f4-f0ab84c4f088 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:07.019275 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d62d911a-5ece-4cca-b1f4-f0ab84c4f088 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:07.032061 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d62d911a-5ece-4cca-b1f4-f0ab84c4f088 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:07.032061 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d62d911a-5ece-4cca-b1f4-f0ab84c4f088 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:07.033147 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d62d911a-5ece-4cca-b1f4-f0ab84c4f088 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:07.033655 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d62d911a-5ece-4cca-b1f4-f0ab84c4f088 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:07.169448 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4c5667da-2df4-4506-af87-dea85289b51d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:07.177565 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4c5667da-2df4-4506-af87-dea85289b51d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.249289 Nov 12 02:27:07.178241 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 82/196] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:06 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:07.183197 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0e08e23e-7a22-4fde-8df2-ca42ef2537d9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:07.184778 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0e08e23e-7a22-4fde-8df2-ca42ef2537d9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:07.191494 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0e08e23e-7a22-4fde-8df2-ca42ef2537d9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:07.192181 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0e08e23e-7a22-4fde-8df2-ca42ef2537d9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:07.193088 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0e08e23e-7a22-4fde-8df2-ca42ef2537d9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:07.193618 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0e08e23e-7a22-4fde-8df2-ca42ef2537d9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:07.269295 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d62d911a-5ece-4cca-b1f4-f0ab84c4f088 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:07.287625 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d62d911a-5ece-4cca-b1f4-f0ab84c4f088 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:07.289492 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d62d911a-5ece-4cca-b1f4-f0ab84c4f088 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:07.290612 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d62d911a-5ece-4cca-b1f4-f0ab84c4f088 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.278282 Nov 12 02:27:07.291218 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 115/197] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:07 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:07.354402 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0e08e23e-7a22-4fde-8df2-ca42ef2537d9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:07.361585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0e08e23e-7a22-4fde-8df2-ca42ef2537d9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.181771 Nov 12 02:27:07.362174 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 83/198] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:07 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:07.873698 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-eb155081-dc62-420b-bc29-2a06424dabbe tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:07.874328 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-eb155081-dc62-420b-bc29-2a06424dabbe tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:07.880153 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eb155081-dc62-420b-bc29-2a06424dabbe tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:07.880603 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eb155081-dc62-420b-bc29-2a06424dabbe tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:07.881088 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-eec63a11-84f7-48f0-8bb0-18e3bc947360 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:07.881529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eb155081-dc62-420b-bc29-2a06424dabbe tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:07.881701 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-eec63a11-84f7-48f0-8bb0-18e3bc947360 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:07.881837 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eb155081-dc62-420b-bc29-2a06424dabbe tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:07.888687 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eec63a11-84f7-48f0-8bb0-18e3bc947360 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:07.889354 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eec63a11-84f7-48f0-8bb0-18e3bc947360 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:07.890132 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eec63a11-84f7-48f0-8bb0-18e3bc947360 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:07.890561 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eec63a11-84f7-48f0-8bb0-18e3bc947360 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:08.095931 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-eb155081-dc62-420b-bc29-2a06424dabbe tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:08.102384 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-eec63a11-84f7-48f0-8bb0-18e3bc947360 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:08.103669 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-eb155081-dc62-420b-bc29-2a06424dabbe tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.233604 Nov 12 02:27:08.104995 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 116/199] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:07 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:08.110480 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-eec63a11-84f7-48f0-8bb0-18e3bc947360 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.232896 Nov 12 02:27:08.111308 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 84/200] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:07 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:08.193307 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-107dfe09-a027-4f6d-acbe-7dc98e7536b2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:08.193905 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-107dfe09-a027-4f6d-acbe-7dc98e7536b2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:08.200939 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-107dfe09-a027-4f6d-acbe-7dc98e7536b2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:08.201768 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-107dfe09-a027-4f6d-acbe-7dc98e7536b2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:08.203113 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-107dfe09-a027-4f6d-acbe-7dc98e7536b2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:08.203605 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-107dfe09-a027-4f6d-acbe-7dc98e7536b2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:08.309757 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2f66bce8-21af-4240-a9b8-35a985e99450 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:08.310347 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2f66bce8-21af-4240-a9b8-35a985e99450 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:08.316345 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f66bce8-21af-4240-a9b8-35a985e99450 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:08.316791 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f66bce8-21af-4240-a9b8-35a985e99450 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:08.317567 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f66bce8-21af-4240-a9b8-35a985e99450 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:08.317996 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f66bce8-21af-4240-a9b8-35a985e99450 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:08.339000 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-107dfe09-a027-4f6d-acbe-7dc98e7536b2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:08.348712 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-107dfe09-a027-4f6d-acbe-7dc98e7536b2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.159129 Nov 12 02:27:08.349897 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 117/201] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:08 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:08.379334 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-819fe5c6-06be-4273-8747-faf28fa22812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:08.380383 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-819fe5c6-06be-4273-8747-faf28fa22812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:08.387471 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-819fe5c6-06be-4273-8747-faf28fa22812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:08.389203 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-819fe5c6-06be-4273-8747-faf28fa22812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:08.390324 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-819fe5c6-06be-4273-8747-faf28fa22812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:08.390929 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-819fe5c6-06be-4273-8747-faf28fa22812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:08.500528 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2f66bce8-21af-4240-a9b8-35a985e99450 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:08.508289 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2f66bce8-21af-4240-a9b8-35a985e99450 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:08.509783 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2f66bce8-21af-4240-a9b8-35a985e99450 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:08.510926 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2f66bce8-21af-4240-a9b8-35a985e99450 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.205809 Nov 12 02:27:08.511485 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 85/202] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:08 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:08.558127 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-819fe5c6-06be-4273-8747-faf28fa22812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:08.565421 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-819fe5c6-06be-4273-8747-faf28fa22812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.190463 Nov 12 02:27:08.565977 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 118/203] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:08 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:09.120193 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bf5d6c57-3e44-4857-85b0-437bd1ea0242 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:09.120804 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bf5d6c57-3e44-4857-85b0-437bd1ea0242 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:09.126834 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf5d6c57-3e44-4857-85b0-437bd1ea0242 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:09.127289 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf5d6c57-3e44-4857-85b0-437bd1ea0242 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:09.127878 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-30769b45-afbc-4794-b10f-d4818168ec7e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:09.128280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf5d6c57-3e44-4857-85b0-437bd1ea0242 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:09.128460 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-30769b45-afbc-4794-b10f-d4818168ec7e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:09.128568 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bf5d6c57-3e44-4857-85b0-437bd1ea0242 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:09.134631 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-30769b45-afbc-4794-b10f-d4818168ec7e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:09.135123 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-30769b45-afbc-4794-b10f-d4818168ec7e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:09.135940 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-30769b45-afbc-4794-b10f-d4818168ec7e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:09.136525 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-30769b45-afbc-4794-b10f-d4818168ec7e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:09.524827 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bf5d6c57-3e44-4857-85b0-437bd1ea0242 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:09.533582 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-30769b45-afbc-4794-b10f-d4818168ec7e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:09.536586 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bf5d6c57-3e44-4857-85b0-437bd1ea0242 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.420093 Nov 12 02:27:09.537515 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 86/204] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:09 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:09.542158 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7f1e3544-00bf-4628-8778-600b4be46b0f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:09.543596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7f1e3544-00bf-4628-8778-600b4be46b0f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:09.549319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f1e3544-00bf-4628-8778-600b4be46b0f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:09.549861 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f1e3544-00bf-4628-8778-600b4be46b0f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:09.550741 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f1e3544-00bf-4628-8778-600b4be46b0f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:09.551236 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-30769b45-afbc-4794-b10f-d4818168ec7e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.426838 Nov 12 02:27:09.551385 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f1e3544-00bf-4628-8778-600b4be46b0f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:09.551836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 119/205] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:09 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:09.556507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b673b8bb-7248-492d-816e-d7f335794d3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:09.557097 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b673b8bb-7248-492d-816e-d7f335794d3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:09.562964 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b673b8bb-7248-492d-816e-d7f335794d3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:09.563406 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b673b8bb-7248-492d-816e-d7f335794d3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:09.564168 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b673b8bb-7248-492d-816e-d7f335794d3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:09.564599 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b673b8bb-7248-492d-816e-d7f335794d3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:09.762835 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7f1e3544-00bf-4628-8778-600b4be46b0f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:09.773548 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7f1e3544-00bf-4628-8778-600b4be46b0f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.234730 Nov 12 02:27:09.774236 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 87/206] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:09 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:09.774929 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b673b8bb-7248-492d-816e-d7f335794d3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:09.783771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b673b8bb-7248-492d-816e-d7f335794d3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:09.784945 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fca802ea-bbd8-440f-856d-85a51dffb1db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:09.785510 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b673b8bb-7248-492d-816e-d7f335794d3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:09.785864 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fca802ea-bbd8-440f-856d-85a51dffb1db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:09.787276 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b673b8bb-7248-492d-816e-d7f335794d3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.234379 Nov 12 02:27:09.787827 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 120/207] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:09 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:09.792806 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fca802ea-bbd8-440f-856d-85a51dffb1db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:09.793266 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fca802ea-bbd8-440f-856d-85a51dffb1db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:09.794096 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fca802ea-bbd8-440f-856d-85a51dffb1db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:09.794585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fca802ea-bbd8-440f-856d-85a51dffb1db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:09.934554 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fca802ea-bbd8-440f-856d-85a51dffb1db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:09.942039 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fca802ea-bbd8-440f-856d-85a51dffb1db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.166309 Nov 12 02:27:09.942674 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 88/208] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:09 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:10.557562 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2a40bcc3-b889-470f-a622-d69ae584a2c4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:10.558174 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2a40bcc3-b889-470f-a622-d69ae584a2c4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:10.564509 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2a40bcc3-b889-470f-a622-d69ae584a2c4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:10.565200 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2a40bcc3-b889-470f-a622-d69ae584a2c4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:10.566108 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2a40bcc3-b889-470f-a622-d69ae584a2c4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:10.566575 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2a40bcc3-b889-470f-a622-d69ae584a2c4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:10.568275 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1adee4ad-f9ae-46d8-a602-91b6529f8bd4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:10.568876 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1adee4ad-f9ae-46d8-a602-91b6529f8bd4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:10.575558 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1adee4ad-f9ae-46d8-a602-91b6529f8bd4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:10.575960 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1adee4ad-f9ae-46d8-a602-91b6529f8bd4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:10.576730 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1adee4ad-f9ae-46d8-a602-91b6529f8bd4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:10.577181 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1adee4ad-f9ae-46d8-a602-91b6529f8bd4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:10.805259 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1adee4ad-f9ae-46d8-a602-91b6529f8bd4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:10.812622 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1adee4ad-f9ae-46d8-a602-91b6529f8bd4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.247800 Nov 12 02:27:10.813518 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 89/209] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:10 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:10.818750 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-34f986fc-6306-4013-b6af-614c7c69830c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:10.819622 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-34f986fc-6306-4013-b6af-614c7c69830c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:10.826325 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-34f986fc-6306-4013-b6af-614c7c69830c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:10.827562 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-34f986fc-6306-4013-b6af-614c7c69830c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:10.828577 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-34f986fc-6306-4013-b6af-614c7c69830c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:10.829086 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-34f986fc-6306-4013-b6af-614c7c69830c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:10.837106 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-2a40bcc3-b889-470f-a622-d69ae584a2c4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:10.845233 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2a40bcc3-b889-470f-a622-d69ae584a2c4 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.294595 Nov 12 02:27:10.848448 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 121/210] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:10 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:10.853464 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-034ff8e9-f286-4f93-9b26-54ac77303f99 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:10.860973 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-034ff8e9-f286-4f93-9b26-54ac77303f99 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:10.869312 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-034ff8e9-f286-4f93-9b26-54ac77303f99 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:10.870162 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-034ff8e9-f286-4f93-9b26-54ac77303f99 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:10.871043 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-034ff8e9-f286-4f93-9b26-54ac77303f99 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:10.871432 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-034ff8e9-f286-4f93-9b26-54ac77303f99 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:11.049973 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-34f986fc-6306-4013-b6af-614c7c69830c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:11.058220 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-34f986fc-6306-4013-b6af-614c7c69830c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.243402 Nov 12 02:27:11.059757 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 90/211] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:10 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:11.066014 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c705fdee-b4af-44b3-aea7-ba0df8ec7543 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:11.068593 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c705fdee-b4af-44b3-aea7-ba0df8ec7543 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:11.079505 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c705fdee-b4af-44b3-aea7-ba0df8ec7543 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:11.081301 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c705fdee-b4af-44b3-aea7-ba0df8ec7543 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:11.081966 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-034ff8e9-f286-4f93-9b26-54ac77303f99 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:11.088475 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c705fdee-b4af-44b3-aea7-ba0df8ec7543 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:11.089152 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c705fdee-b4af-44b3-aea7-ba0df8ec7543 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:11.095228 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-034ff8e9-f286-4f93-9b26-54ac77303f99 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:11.099516 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-034ff8e9-f286-4f93-9b26-54ac77303f99 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:11.101902 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-034ff8e9-f286-4f93-9b26-54ac77303f99 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.251659 Nov 12 02:27:11.102944 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 122/212] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:10 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:11.274906 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c705fdee-b4af-44b3-aea7-ba0df8ec7543 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:11.283591 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c705fdee-b4af-44b3-aea7-ba0df8ec7543 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.222569 Nov 12 02:27:11.284858 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 91/213] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:11 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:11.497535 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-a74663a9-d035-455a-b2b6-19d6b680f942 req-e08dc7dc-839c-4f2d-a1f7-3e69fe8a9fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8244b795-8dd2-43ee-a703-79b742cd5432", "name": "network-vif-plugged", "status": "completed", "tag": "65d1110b-f099-4749-9cc9-cc0fbaf8af9c"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:11.500966 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:27:11.500966 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:27:11.510318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-a74663a9-d035-455a-b2b6-19d6b680f942 req-e08dc7dc-839c-4f2d-a1f7-3e69fe8a9fa9 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:11.510791 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-a74663a9-d035-455a-b2b6-19d6b680f942 req-e08dc7dc-839c-4f2d-a1f7-3e69fe8a9fa9 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:11.523963 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-a74663a9-d035-455a-b2b6-19d6b680f942 req-e08dc7dc-839c-4f2d-a1f7-3e69fe8a9fa9 service nova] Creating event network-vif-plugged:65d1110b-f099-4749-9cc9-cc0fbaf8af9c for instance 8244b795-8dd2-43ee-a703-79b742cd5432 on hv-cinder-80857 Nov 12 02:27:11.541936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-a74663a9-d035-455a-b2b6-19d6b680f942 req-e08dc7dc-839c-4f2d-a1f7-3e69fe8a9fa9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129691 Nov 12 02:27:11.542558 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 123/214] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:27:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:27:11.830683 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4bcd035c-90b9-4f97-97bf-1022e2734f65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:11.831998 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4bcd035c-90b9-4f97-97bf-1022e2734f65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:11.840612 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4bcd035c-90b9-4f97-97bf-1022e2734f65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:11.841551 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4bcd035c-90b9-4f97-97bf-1022e2734f65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:11.842385 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4bcd035c-90b9-4f97-97bf-1022e2734f65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:11.842871 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4bcd035c-90b9-4f97-97bf-1022e2734f65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:11.864245 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-36541b7f-6eed-4b8b-9886-3b3c439c38b6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:11.865471 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-36541b7f-6eed-4b8b-9886-3b3c439c38b6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:11.873664 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-36541b7f-6eed-4b8b-9886-3b3c439c38b6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:11.874135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-36541b7f-6eed-4b8b-9886-3b3c439c38b6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:11.875001 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-36541b7f-6eed-4b8b-9886-3b3c439c38b6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:11.875789 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-36541b7f-6eed-4b8b-9886-3b3c439c38b6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:12.177807 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4bcd035c-90b9-4f97-97bf-1022e2734f65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:12.188288 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-36541b7f-6eed-4b8b-9886-3b3c439c38b6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:12.188679 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4bcd035c-90b9-4f97-97bf-1022e2734f65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.362035 Nov 12 02:27:12.189466 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 92/215] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:11 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:12.196010 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c7f7bd90-5b9b-4c65-929e-909e20730282 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:12.197321 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c7f7bd90-5b9b-4c65-929e-909e20730282 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:12.198419 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-36541b7f-6eed-4b8b-9886-3b3c439c38b6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.337300 Nov 12 02:27:12.201007 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 124/216] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:11 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:12.204856 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7f7bd90-5b9b-4c65-929e-909e20730282 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:12.205485 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7f7bd90-5b9b-4c65-929e-909e20730282 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:12.206984 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7f7bd90-5b9b-4c65-929e-909e20730282 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:12.207575 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7f7bd90-5b9b-4c65-929e-909e20730282 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:12.212061 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9ae599e8-a816-467b-a0d0-e87990271cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:12.215725 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9ae599e8-a816-467b-a0d0-e87990271cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:12.225579 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9ae599e8-a816-467b-a0d0-e87990271cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:12.226035 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9ae599e8-a816-467b-a0d0-e87990271cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:12.227490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9ae599e8-a816-467b-a0d0-e87990271cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:12.227961 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9ae599e8-a816-467b-a0d0-e87990271cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:12.440966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c7f7bd90-5b9b-4c65-929e-909e20730282 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:12.463424 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c7f7bd90-5b9b-4c65-929e-909e20730282 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.272772 Nov 12 02:27:12.464542 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 93/217] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:12 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:12.481328 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9ae599e8-a816-467b-a0d0-e87990271cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:12.483439 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-13bd1319-cfc7-478e-b901-ad9cbb27553e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:12.485718 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-13bd1319-cfc7-478e-b901-ad9cbb27553e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:12.492282 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9ae599e8-a816-467b-a0d0-e87990271cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:12.498656 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9ae599e8-a816-467b-a0d0-e87990271cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:12.502231 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9ae599e8-a816-467b-a0d0-e87990271cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.300042 Nov 12 02:27:12.513512 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 125/218] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:12 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:12.513834 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-13bd1319-cfc7-478e-b901-ad9cbb27553e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:12.513834 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-13bd1319-cfc7-478e-b901-ad9cbb27553e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:12.513834 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-13bd1319-cfc7-478e-b901-ad9cbb27553e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:12.513834 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-13bd1319-cfc7-478e-b901-ad9cbb27553e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:12.763980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-13bd1319-cfc7-478e-b901-ad9cbb27553e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:12.771822 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-13bd1319-cfc7-478e-b901-ad9cbb27553e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.305123 Nov 12 02:27:12.772399 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 94/219] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:12 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:13.205098 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-514600ce-7bec-4ae5-9a33-2e9711d202c4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:13.205759 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-514600ce-7bec-4ae5-9a33-2e9711d202c4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:13.212206 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-514600ce-7bec-4ae5-9a33-2e9711d202c4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:13.212642 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-514600ce-7bec-4ae5-9a33-2e9711d202c4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:13.213438 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-514600ce-7bec-4ae5-9a33-2e9711d202c4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:13.213866 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-514600ce-7bec-4ae5-9a33-2e9711d202c4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:13.215150 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cee01f2c-a43b-41b3-9554-a831e7048dd1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:13.215863 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cee01f2c-a43b-41b3-9554-a831e7048dd1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:13.222094 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cee01f2c-a43b-41b3-9554-a831e7048dd1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:13.222606 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cee01f2c-a43b-41b3-9554-a831e7048dd1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:13.223512 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cee01f2c-a43b-41b3-9554-a831e7048dd1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:13.224103 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cee01f2c-a43b-41b3-9554-a831e7048dd1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:13.420401 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cee01f2c-a43b-41b3-9554-a831e7048dd1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:13.423437 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-514600ce-7bec-4ae5-9a33-2e9711d202c4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:13.430131 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cee01f2c-a43b-41b3-9554-a831e7048dd1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.219027 Nov 12 02:27:13.430930 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 95/220] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:13 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:13.431168 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-514600ce-7bec-4ae5-9a33-2e9711d202c4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.229838 Nov 12 02:27:13.431783 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 126/221] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:13 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:13.484497 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-63321108-9cac-401e-9bb3-1575b56480ca tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:13.485282 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-63321108-9cac-401e-9bb3-1575b56480ca tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:13.509285 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-63321108-9cac-401e-9bb3-1575b56480ca tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:13.509732 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-63321108-9cac-401e-9bb3-1575b56480ca tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:13.510512 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-63321108-9cac-401e-9bb3-1575b56480ca tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:13.510964 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-63321108-9cac-401e-9bb3-1575b56480ca tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:13.521015 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-bd44cd54-293f-4c9d-b5f7-a4c9c4a4f18e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:13.521612 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-bd44cd54-293f-4c9d-b5f7-a4c9c4a4f18e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:13.536714 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bd44cd54-293f-4c9d-b5f7-a4c9c4a4f18e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:13.537818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bd44cd54-293f-4c9d-b5f7-a4c9c4a4f18e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:13.538927 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bd44cd54-293f-4c9d-b5f7-a4c9c4a4f18e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:13.539584 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bd44cd54-293f-4c9d-b5f7-a4c9c4a4f18e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:13.730935 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-63321108-9cac-401e-9bb3-1575b56480ca tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:13.735129 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-bd44cd54-293f-4c9d-b5f7-a4c9c4a4f18e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:13.740828 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-63321108-9cac-401e-9bb3-1575b56480ca tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.262827 Nov 12 02:27:13.741699 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 96/222] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:13 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:13.746501 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-462eed6d-a10c-43b2-b47a-d162992c1c7c req-38e1ab94-0ff3-4fd9-a2bd-849a9c785f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701cf4eb-6d33-4aa4-a762-2cae743dd618", "name": "network-vif-plugged", "status": "completed", "tag": "b7a3e8e1-ad9e-43fd-945c-a4294eb6d9b9"}, {"server_uuid": "44c025f0-3bb5-4ce5-944f-0f553ef80f8a", "name": "network-vif-plugged", "status": "completed", "tag": "827c9b0b-5bbb-48cc-9c27-94e0fb2378a2"}, {"server_uuid": "26d16c68-a04c-4a32-a599-e202e6c64152", "name": "network-vif-plugged", "status": "completed", "tag": "6159a4de-08df-4c5b-afb6-bc1f4e2f213f"}, {"server_uuid": "7dc3ef58-e30c-44da-bef1-9678e3c7b14a", "name": "network-vif-plugged", "status": "completed", "tag": "838aaf11-0ed7-4529-b85a-74acc6e006ad"}, {"server_uuid": "5c1ce3bd-1739-49be-ab2e-e81c1026ae30", "name": "network-vif-plugged", "status": "completed", "tag": "2c2246ad-0135-4e41-9bee-c87015e386f7"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:13.748613 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:27:13.748613 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:27:13.751945 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-bd44cd54-293f-4c9d-b5f7-a4c9c4a4f18e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:13.753558 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-bd44cd54-293f-4c9d-b5f7-a4c9c4a4f18e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:13.755474 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-bd44cd54-293f-4c9d-b5f7-a4c9c4a4f18e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.237994 Nov 12 02:27:13.756022 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 127/223] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:13 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:13.763450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-462eed6d-a10c-43b2-b47a-d162992c1c7c req-38e1ab94-0ff3-4fd9-a2bd-849a9c785f9e service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:13.764100 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-462eed6d-a10c-43b2-b47a-d162992c1c7c req-38e1ab94-0ff3-4fd9-a2bd-849a9c785f9e service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:13.782754 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-462eed6d-a10c-43b2-b47a-d162992c1c7c req-38e1ab94-0ff3-4fd9-a2bd-849a9c785f9e service nova] Creating event network-vif-plugged:b7a3e8e1-ad9e-43fd-945c-a4294eb6d9b9 for instance 701cf4eb-6d33-4aa4-a762-2cae743dd618 on hv-cinder-80857 Nov 12 02:27:13.783520 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-462eed6d-a10c-43b2-b47a-d162992c1c7c req-38e1ab94-0ff3-4fd9-a2bd-849a9c785f9e service nova] Creating event network-vif-plugged:827c9b0b-5bbb-48cc-9c27-94e0fb2378a2 for instance 44c025f0-3bb5-4ce5-944f-0f553ef80f8a on hv-cinder-80857 Nov 12 02:27:13.784191 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-462eed6d-a10c-43b2-b47a-d162992c1c7c req-38e1ab94-0ff3-4fd9-a2bd-849a9c785f9e service nova] Creating event network-vif-plugged:6159a4de-08df-4c5b-afb6-bc1f4e2f213f for instance 26d16c68-a04c-4a32-a599-e202e6c64152 on hv-cinder-80857 Nov 12 02:27:13.784682 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-462eed6d-a10c-43b2-b47a-d162992c1c7c req-38e1ab94-0ff3-4fd9-a2bd-849a9c785f9e service nova] Creating event network-vif-plugged:838aaf11-0ed7-4529-b85a-74acc6e006ad for instance 7dc3ef58-e30c-44da-bef1-9678e3c7b14a on hv-cinder-80857 Nov 12 02:27:13.785172 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-462eed6d-a10c-43b2-b47a-d162992c1c7c req-38e1ab94-0ff3-4fd9-a2bd-849a9c785f9e service nova] Creating event network-vif-plugged:2c2246ad-0135-4e41-9bee-c87015e386f7 for instance 5c1ce3bd-1739-49be-ab2e-e81c1026ae30 on hv-cinder-80857 Nov 12 02:27:13.788589 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b58b1a30-c2a5-4e55-a545-6b4b03ebcb29 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:13.789194 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b58b1a30-c2a5-4e55-a545-6b4b03ebcb29 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:13.795261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b58b1a30-c2a5-4e55-a545-6b4b03ebcb29 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:13.795660 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b58b1a30-c2a5-4e55-a545-6b4b03ebcb29 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:13.796418 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b58b1a30-c2a5-4e55-a545-6b4b03ebcb29 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:13.796845 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b58b1a30-c2a5-4e55-a545-6b4b03ebcb29 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:13.797286 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-462eed6d-a10c-43b2-b47a-d162992c1c7c req-38e1ab94-0ff3-4fd9-a2bd-849a9c785f9e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.054267 Nov 12 02:27:13.797981 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 97/224] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:27:13 2021] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:27:13.937348 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b58b1a30-c2a5-4e55-a545-6b4b03ebcb29 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:13.944892 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b58b1a30-c2a5-4e55-a545-6b4b03ebcb29 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.160519 Nov 12 02:27:13.950536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 128/225] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:13 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:14.447591 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-22455743-6a8e-4602-aa48-bc9ae0d7411d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:14.448318 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-22455743-6a8e-4602-aa48-bc9ae0d7411d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:14.448623 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ec8978c9-4dbc-4a5e-9c65-db5f00b527de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:14.449465 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ec8978c9-4dbc-4a5e-9c65-db5f00b527de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:14.454590 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22455743-6a8e-4602-aa48-bc9ae0d7411d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:14.454983 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22455743-6a8e-4602-aa48-bc9ae0d7411d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:14.456593 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22455743-6a8e-4602-aa48-bc9ae0d7411d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:14.456593 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22455743-6a8e-4602-aa48-bc9ae0d7411d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:14.456769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ec8978c9-4dbc-4a5e-9c65-db5f00b527de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:14.456769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ec8978c9-4dbc-4a5e-9c65-db5f00b527de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:14.457692 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ec8978c9-4dbc-4a5e-9c65-db5f00b527de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:14.458645 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ec8978c9-4dbc-4a5e-9c65-db5f00b527de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:14.661710 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ec8978c9-4dbc-4a5e-9c65-db5f00b527de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:14.667366 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-22455743-6a8e-4602-aa48-bc9ae0d7411d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:14.669367 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ec8978c9-4dbc-4a5e-9c65-db5f00b527de tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.225192 Nov 12 02:27:14.669937 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 129/226] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:14 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:14.676849 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-22455743-6a8e-4602-aa48-bc9ae0d7411d tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.233239 Nov 12 02:27:14.677486 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 98/227] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:14 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:14.757279 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3cf1c414-74b9-4eea-9236-dc3f6a2a36cc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:14.757885 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3cf1c414-74b9-4eea-9236-dc3f6a2a36cc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:14.764545 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3cf1c414-74b9-4eea-9236-dc3f6a2a36cc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:14.765078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3cf1c414-74b9-4eea-9236-dc3f6a2a36cc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:14.766022 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3cf1c414-74b9-4eea-9236-dc3f6a2a36cc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:14.766631 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3cf1c414-74b9-4eea-9236-dc3f6a2a36cc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:14.776803 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-06330a5f-bd17-416c-83c9-f609cb232b60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:14.777997 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-06330a5f-bd17-416c-83c9-f609cb232b60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:14.784566 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-06330a5f-bd17-416c-83c9-f609cb232b60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:14.785436 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-06330a5f-bd17-416c-83c9-f609cb232b60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:14.786509 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-06330a5f-bd17-416c-83c9-f609cb232b60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:14.786980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-06330a5f-bd17-416c-83c9-f609cb232b60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:15.021745 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3cf1c414-74b9-4eea-9236-dc3f6a2a36cc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:15.029273 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3cf1c414-74b9-4eea-9236-dc3f6a2a36cc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.276003 Nov 12 02:27:15.030178 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 130/228] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:14 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:15.042012 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-74c67d76-8207-4b6d-9388-3bd38bb5f084 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:15.042319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-06330a5f-bd17-416c-83c9-f609cb232b60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:15.042615 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-74c67d76-8207-4b6d-9388-3bd38bb5f084 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:15.048859 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-74c67d76-8207-4b6d-9388-3bd38bb5f084 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:15.049546 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-74c67d76-8207-4b6d-9388-3bd38bb5f084 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:15.050247 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-06330a5f-bd17-416c-83c9-f609cb232b60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:15.050367 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-74c67d76-8207-4b6d-9388-3bd38bb5f084 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:15.050775 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-74c67d76-8207-4b6d-9388-3bd38bb5f084 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:15.052286 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-06330a5f-bd17-416c-83c9-f609cb232b60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:15.053372 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-06330a5f-bd17-416c-83c9-f609cb232b60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.283039 Nov 12 02:27:15.054079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 99/229] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:14 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:15.218826 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-74c67d76-8207-4b6d-9388-3bd38bb5f084 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:15.226513 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-74c67d76-8207-4b6d-9388-3bd38bb5f084 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.195512 Nov 12 02:27:15.227121 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 131/230] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:15 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:15.685128 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bfeab083-e27b-4b5b-95f9-7374d32572cd tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:15.685662 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bfeab083-e27b-4b5b-95f9-7374d32572cd tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:15.691543 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bfeab083-e27b-4b5b-95f9-7374d32572cd tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:15.691986 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bfeab083-e27b-4b5b-95f9-7374d32572cd tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:15.692965 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bfeab083-e27b-4b5b-95f9-7374d32572cd tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:15.693078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ff14456e-6464-488f-a25b-1e6915b8fb30 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:15.693485 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bfeab083-e27b-4b5b-95f9-7374d32572cd tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:15.693624 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ff14456e-6464-488f-a25b-1e6915b8fb30 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:15.699668 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ff14456e-6464-488f-a25b-1e6915b8fb30 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:15.700119 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ff14456e-6464-488f-a25b-1e6915b8fb30 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:15.700899 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ff14456e-6464-488f-a25b-1e6915b8fb30 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:15.701336 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ff14456e-6464-488f-a25b-1e6915b8fb30 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:15.936101 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ff14456e-6464-488f-a25b-1e6915b8fb30 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:15.938472 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bfeab083-e27b-4b5b-95f9-7374d32572cd tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:15.943621 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ff14456e-6464-488f-a25b-1e6915b8fb30 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.254006 Nov 12 02:27:15.944730 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 132/231] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:15 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:15.960054 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bfeab083-e27b-4b5b-95f9-7374d32572cd tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.278532 Nov 12 02:27:15.960638 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 100/232] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:15 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:16.045161 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b40d8347-a71c-4738-81a4-e5243d740ac0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:16.045801 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b40d8347-a71c-4738-81a4-e5243d740ac0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:16.051710 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b40d8347-a71c-4738-81a4-e5243d740ac0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:16.052161 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b40d8347-a71c-4738-81a4-e5243d740ac0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:16.052936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b40d8347-a71c-4738-81a4-e5243d740ac0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:16.053391 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b40d8347-a71c-4738-81a4-e5243d740ac0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:16.072935 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1d115669-cf3e-47c1-b323-2ed06b497018 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:16.073830 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1d115669-cf3e-47c1-b323-2ed06b497018 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:16.080049 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d115669-cf3e-47c1-b323-2ed06b497018 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:16.080861 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d115669-cf3e-47c1-b323-2ed06b497018 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:16.081860 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d115669-cf3e-47c1-b323-2ed06b497018 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:16.082503 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d115669-cf3e-47c1-b323-2ed06b497018 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:16.244999 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b40d8347-a71c-4738-81a4-e5243d740ac0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:16.252375 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b40d8347-a71c-4738-81a4-e5243d740ac0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.211000 Nov 12 02:27:16.252947 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 133/233] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:16 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:16.257223 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7d11db51-ac9c-47eb-922a-8dabe0c0f3d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:16.257822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7d11db51-ac9c-47eb-922a-8dabe0c0f3d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:16.263688 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7d11db51-ac9c-47eb-922a-8dabe0c0f3d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:16.264144 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7d11db51-ac9c-47eb-922a-8dabe0c0f3d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:16.264927 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7d11db51-ac9c-47eb-922a-8dabe0c0f3d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:16.265364 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7d11db51-ac9c-47eb-922a-8dabe0c0f3d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:16.279126 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1d115669-cf3e-47c1-b323-2ed06b497018 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:16.287640 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1d115669-cf3e-47c1-b323-2ed06b497018 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:16.289156 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1d115669-cf3e-47c1-b323-2ed06b497018 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:16.290246 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1d115669-cf3e-47c1-b323-2ed06b497018 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.221046 Nov 12 02:27:16.291011 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 101/234] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:16 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:16.403274 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7d11db51-ac9c-47eb-922a-8dabe0c0f3d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:16.410435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7d11db51-ac9c-47eb-922a-8dabe0c0f3d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.156567 Nov 12 02:27:16.411049 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 134/235] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:16 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:16.961169 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b9615d84-3bd7-49b5-be2b-fd6b72d8deb5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:16.961725 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b9615d84-3bd7-49b5-be2b-fd6b72d8deb5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:16.967538 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9615d84-3bd7-49b5-be2b-fd6b72d8deb5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:16.967991 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9615d84-3bd7-49b5-be2b-fd6b72d8deb5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:16.968799 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9615d84-3bd7-49b5-be2b-fd6b72d8deb5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:16.969235 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9615d84-3bd7-49b5-be2b-fd6b72d8deb5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:16.978232 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7081d4c6-afe5-4e83-96a7-8b28cb732925 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:16.978232 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7081d4c6-afe5-4e83-96a7-8b28cb732925 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:16.984486 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7081d4c6-afe5-4e83-96a7-8b28cb732925 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:16.985010 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7081d4c6-afe5-4e83-96a7-8b28cb732925 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:16.985846 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7081d4c6-afe5-4e83-96a7-8b28cb732925 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:16.986371 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7081d4c6-afe5-4e83-96a7-8b28cb732925 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:17.173200 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b9615d84-3bd7-49b5-be2b-fd6b72d8deb5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:17.181156 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b9615d84-3bd7-49b5-be2b-fd6b72d8deb5 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.224194 Nov 12 02:27:17.181733 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 102/236] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:16 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:17.199921 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7081d4c6-afe5-4e83-96a7-8b28cb732925 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:17.207274 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7081d4c6-afe5-4e83-96a7-8b28cb732925 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.234184 Nov 12 02:27:17.208348 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 135/237] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:16 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:17.269080 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3eaa08f6-b112-4dfa-9a11-5be089b3f126 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:17.269846 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3eaa08f6-b112-4dfa-9a11-5be089b3f126 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:17.277331 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3eaa08f6-b112-4dfa-9a11-5be089b3f126 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:17.277812 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3eaa08f6-b112-4dfa-9a11-5be089b3f126 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:17.278592 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3eaa08f6-b112-4dfa-9a11-5be089b3f126 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:17.279056 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3eaa08f6-b112-4dfa-9a11-5be089b3f126 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:17.310525 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-726af8ca-1162-404e-a009-0d22161284a5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:17.311429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-726af8ca-1162-404e-a009-0d22161284a5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:17.317671 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-726af8ca-1162-404e-a009-0d22161284a5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:17.318341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-726af8ca-1162-404e-a009-0d22161284a5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:17.319163 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-726af8ca-1162-404e-a009-0d22161284a5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:17.319597 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-726af8ca-1162-404e-a009-0d22161284a5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:17.478810 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3eaa08f6-b112-4dfa-9a11-5be089b3f126 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:17.486838 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3eaa08f6-b112-4dfa-9a11-5be089b3f126 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.221544 Nov 12 02:27:17.496610 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 103/238] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:17 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:17.496610 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-274027ef-6363-4bba-bcde-2aa1212b6f23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:17.496610 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-274027ef-6363-4bba-bcde-2aa1212b6f23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:17.499659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-274027ef-6363-4bba-bcde-2aa1212b6f23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:17.500316 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-274027ef-6363-4bba-bcde-2aa1212b6f23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:17.501621 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-274027ef-6363-4bba-bcde-2aa1212b6f23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:17.501621 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-274027ef-6363-4bba-bcde-2aa1212b6f23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:17.528867 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-726af8ca-1162-404e-a009-0d22161284a5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:17.537249 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-726af8ca-1162-404e-a009-0d22161284a5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:17.538791 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-726af8ca-1162-404e-a009-0d22161284a5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:17.539860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-726af8ca-1162-404e-a009-0d22161284a5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.232998 Nov 12 02:27:17.540402 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 136/239] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:17 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:17.644415 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-274027ef-6363-4bba-bcde-2aa1212b6f23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:17.652695 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-274027ef-6363-4bba-bcde-2aa1212b6f23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.163972 Nov 12 02:27:17.653261 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 104/240] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:17 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:18.198403 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-50b40a9a-55b7-434d-a1f5-d02dc00e58cb tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:18.199331 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-50b40a9a-55b7-434d-a1f5-d02dc00e58cb tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:18.205249 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-50b40a9a-55b7-434d-a1f5-d02dc00e58cb tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:18.205760 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-50b40a9a-55b7-434d-a1f5-d02dc00e58cb tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:18.206530 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-50b40a9a-55b7-434d-a1f5-d02dc00e58cb tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:18.207021 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-50b40a9a-55b7-434d-a1f5-d02dc00e58cb tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:18.224554 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8db2f949-a47f-40b7-a193-dc05b78341c9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:18.225193 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8db2f949-a47f-40b7-a193-dc05b78341c9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:18.231001 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8db2f949-a47f-40b7-a193-dc05b78341c9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:18.231380 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8db2f949-a47f-40b7-a193-dc05b78341c9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:18.232155 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8db2f949-a47f-40b7-a193-dc05b78341c9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:18.232585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8db2f949-a47f-40b7-a193-dc05b78341c9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:18.433384 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8db2f949-a47f-40b7-a193-dc05b78341c9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:18.436822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-50b40a9a-55b7-434d-a1f5-d02dc00e58cb tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:18.447968 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-50b40a9a-55b7-434d-a1f5-d02dc00e58cb tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.252987 Nov 12 02:27:18.450407 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 137/241] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:18 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:18.455320 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8db2f949-a47f-40b7-a193-dc05b78341c9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.234517 Nov 12 02:27:18.456046 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 105/242] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:18 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:18.505429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1500cd50-da8b-4a8b-9352-50cb934902d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:18.506119 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1500cd50-da8b-4a8b-9352-50cb934902d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:18.513262 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1500cd50-da8b-4a8b-9352-50cb934902d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:18.513741 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1500cd50-da8b-4a8b-9352-50cb934902d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:18.514535 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1500cd50-da8b-4a8b-9352-50cb934902d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:18.515035 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1500cd50-da8b-4a8b-9352-50cb934902d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:18.558240 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b1dbc548-08f1-4c2b-8f34-4f10efc16f62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:18.559250 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b1dbc548-08f1-4c2b-8f34-4f10efc16f62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:18.568418 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b1dbc548-08f1-4c2b-8f34-4f10efc16f62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:18.569142 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b1dbc548-08f1-4c2b-8f34-4f10efc16f62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:18.570093 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b1dbc548-08f1-4c2b-8f34-4f10efc16f62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:18.570712 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b1dbc548-08f1-4c2b-8f34-4f10efc16f62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:19.054066 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1500cd50-da8b-4a8b-9352-50cb934902d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:19.059473 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b1dbc548-08f1-4c2b-8f34-4f10efc16f62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:19.064959 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1500cd50-da8b-4a8b-9352-50cb934902d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.564094 Nov 12 02:27:19.066070 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 138/243] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:18 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:19.068301 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b1dbc548-08f1-4c2b-8f34-4f10efc16f62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:19.072831 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b24e64cb-77e0-48a2-8b03-61f069e8b4de tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:19.073607 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b24e64cb-77e0-48a2-8b03-61f069e8b4de tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:19.076888 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b1dbc548-08f1-4c2b-8f34-4f10efc16f62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:19.078049 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b1dbc548-08f1-4c2b-8f34-4f10efc16f62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.523899 Nov 12 02:27:19.078600 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 106/244] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:18 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:19.088776 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b24e64cb-77e0-48a2-8b03-61f069e8b4de tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:19.089727 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b24e64cb-77e0-48a2-8b03-61f069e8b4de tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:19.090708 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b24e64cb-77e0-48a2-8b03-61f069e8b4de tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:19.091352 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b24e64cb-77e0-48a2-8b03-61f069e8b4de tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:19.394954 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b24e64cb-77e0-48a2-8b03-61f069e8b4de tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:19.402062 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b24e64cb-77e0-48a2-8b03-61f069e8b4de tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.333721 Nov 12 02:27:19.402833 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 139/245] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:19 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:19.466005 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-af76b268-fe7c-491b-b410-bfcfa98e350c tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:19.466610 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-af76b268-fe7c-491b-b410-bfcfa98e350c tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:19.472095 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e8abe1e2-1f88-4ecc-8bec-3cd72b9de89b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:19.472709 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e8abe1e2-1f88-4ecc-8bec-3cd72b9de89b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:19.472921 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-af76b268-fe7c-491b-b410-bfcfa98e350c tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:19.473295 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-af76b268-fe7c-491b-b410-bfcfa98e350c tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:19.474416 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-af76b268-fe7c-491b-b410-bfcfa98e350c tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:19.475026 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-af76b268-fe7c-491b-b410-bfcfa98e350c tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:19.478645 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8abe1e2-1f88-4ecc-8bec-3cd72b9de89b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:19.479124 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8abe1e2-1f88-4ecc-8bec-3cd72b9de89b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:19.479895 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8abe1e2-1f88-4ecc-8bec-3cd72b9de89b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:19.480327 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8abe1e2-1f88-4ecc-8bec-3cd72b9de89b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:19.677123 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e8abe1e2-1f88-4ecc-8bec-3cd72b9de89b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:19.684281 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-af76b268-fe7c-491b-b410-bfcfa98e350c tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:19.684621 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e8abe1e2-1f88-4ecc-8bec-3cd72b9de89b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.216079 Nov 12 02:27:19.685264 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 140/246] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:19 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:19.701736 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-af76b268-fe7c-491b-b410-bfcfa98e350c tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.239158 Nov 12 02:27:19.702321 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 107/247] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:19 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:20.084110 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-93b2461c-71e1-43a3-814c-ec6b1b80b39d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:20.084822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-93b2461c-71e1-43a3-814c-ec6b1b80b39d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:20.090784 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-93b2461c-71e1-43a3-814c-ec6b1b80b39d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:20.091236 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-93b2461c-71e1-43a3-814c-ec6b1b80b39d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:20.092217 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-93b2461c-71e1-43a3-814c-ec6b1b80b39d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:20.092442 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-93b2461c-71e1-43a3-814c-ec6b1b80b39d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:20.096901 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-336be3a8-4539-40c6-ab66-8ba3d7cb2ca3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:20.097514 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-336be3a8-4539-40c6-ab66-8ba3d7cb2ca3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:20.104311 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-336be3a8-4539-40c6-ab66-8ba3d7cb2ca3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:20.104759 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-336be3a8-4539-40c6-ab66-8ba3d7cb2ca3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:20.105541 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-336be3a8-4539-40c6-ab66-8ba3d7cb2ca3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:20.105972 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-336be3a8-4539-40c6-ab66-8ba3d7cb2ca3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:20.287601 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-93b2461c-71e1-43a3-814c-ec6b1b80b39d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:20.295808 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-93b2461c-71e1-43a3-814c-ec6b1b80b39d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.216578 Nov 12 02:27:20.296384 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 141/248] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:20 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:20.310416 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-336be3a8-4539-40c6-ab66-8ba3d7cb2ca3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:20.318542 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-336be3a8-4539-40c6-ab66-8ba3d7cb2ca3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:20.320262 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-336be3a8-4539-40c6-ab66-8ba3d7cb2ca3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:20.321525 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-336be3a8-4539-40c6-ab66-8ba3d7cb2ca3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.228188 Nov 12 02:27:20.322083 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 108/249] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:20 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:20.419250 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-15176110-0103-4c31-bcf5-fc5f4b08c31e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:20.419861 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-15176110-0103-4c31-bcf5-fc5f4b08c31e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:20.425617 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-15176110-0103-4c31-bcf5-fc5f4b08c31e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:20.426261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-15176110-0103-4c31-bcf5-fc5f4b08c31e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:20.427727 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-15176110-0103-4c31-bcf5-fc5f4b08c31e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:20.428157 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-15176110-0103-4c31-bcf5-fc5f4b08c31e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:20.559684 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-15176110-0103-4c31-bcf5-fc5f4b08c31e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:20.567184 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-15176110-0103-4c31-bcf5-fc5f4b08c31e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.151533 Nov 12 02:27:20.567746 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 142/250] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:20 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:20.700881 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3c76343e-c22c-4c09-a2cb-dfdcfb88ea4c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:20.701488 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3c76343e-c22c-4c09-a2cb-dfdcfb88ea4c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:20.707211 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3c76343e-c22c-4c09-a2cb-dfdcfb88ea4c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:20.707658 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3c76343e-c22c-4c09-a2cb-dfdcfb88ea4c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:20.708422 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3c76343e-c22c-4c09-a2cb-dfdcfb88ea4c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:20.708854 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3c76343e-c22c-4c09-a2cb-dfdcfb88ea4c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:20.719392 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fa13c541-2cc6-427a-8d51-254261e8acaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:20.720335 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-fa13c541-2cc6-427a-8d51-254261e8acaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:20.729779 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fa13c541-2cc6-427a-8d51-254261e8acaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:20.730762 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fa13c541-2cc6-427a-8d51-254261e8acaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:20.732590 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fa13c541-2cc6-427a-8d51-254261e8acaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:20.733303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fa13c541-2cc6-427a-8d51-254261e8acaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:20.937928 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3c76343e-c22c-4c09-a2cb-dfdcfb88ea4c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:20.942056 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-fa13c541-2cc6-427a-8d51-254261e8acaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:20.945539 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3c76343e-c22c-4c09-a2cb-dfdcfb88ea4c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.248131 Nov 12 02:27:20.946325 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 109/251] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:20 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:20.957330 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-fa13c541-2cc6-427a-8d51-254261e8acaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.241855 Nov 12 02:27:20.958461 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 143/252] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:20 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:21.312953 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7a35eda8-e135-42c3-8474-070b516cbfe2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:21.313559 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7a35eda8-e135-42c3-8474-070b516cbfe2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:21.319873 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7a35eda8-e135-42c3-8474-070b516cbfe2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:21.320309 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7a35eda8-e135-42c3-8474-070b516cbfe2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:21.321063 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7a35eda8-e135-42c3-8474-070b516cbfe2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:21.321490 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7a35eda8-e135-42c3-8474-070b516cbfe2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:21.338739 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0f64d75c-d482-43ed-ad7d-e818784057da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:21.339342 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0f64d75c-d482-43ed-ad7d-e818784057da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:21.345069 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0f64d75c-d482-43ed-ad7d-e818784057da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:21.345512 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0f64d75c-d482-43ed-ad7d-e818784057da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:21.346276 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0f64d75c-d482-43ed-ad7d-e818784057da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:21.346728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0f64d75c-d482-43ed-ad7d-e818784057da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:21.517739 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7a35eda8-e135-42c3-8474-070b516cbfe2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:21.521840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0f64d75c-d482-43ed-ad7d-e818784057da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:21.525610 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7a35eda8-e135-42c3-8474-070b516cbfe2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.216095 Nov 12 02:27:21.526174 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 110/253] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:21 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:21.529516 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0f64d75c-d482-43ed-ad7d-e818784057da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:21.531041 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0f64d75c-d482-43ed-ad7d-e818784057da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:21.532133 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0f64d75c-d482-43ed-ad7d-e818784057da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.197003 Nov 12 02:27:21.532671 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 144/254] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:21 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:21.584348 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ec897c8e-5f03-4045-b88f-d9ca5535c655 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:21.584940 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ec897c8e-5f03-4045-b88f-d9ca5535c655 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:21.590692 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec897c8e-5f03-4045-b88f-d9ca5535c655 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:21.591135 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec897c8e-5f03-4045-b88f-d9ca5535c655 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:21.591893 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec897c8e-5f03-4045-b88f-d9ca5535c655 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:21.592320 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec897c8e-5f03-4045-b88f-d9ca5535c655 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:21.719622 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ec897c8e-5f03-4045-b88f-d9ca5535c655 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:21.726684 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ec897c8e-5f03-4045-b88f-d9ca5535c655 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.146464 Nov 12 02:27:21.727238 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 111/255] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:21 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:21.962183 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8b41d32d-40cc-4bff-9868-bccc69162688 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:21.962813 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8b41d32d-40cc-4bff-9868-bccc69162688 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:21.968646 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8b41d32d-40cc-4bff-9868-bccc69162688 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:21.969027 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8b41d32d-40cc-4bff-9868-bccc69162688 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:21.969780 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8b41d32d-40cc-4bff-9868-bccc69162688 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:21.970203 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8b41d32d-40cc-4bff-9868-bccc69162688 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:21.974093 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1ef95245-3aba-45d1-8ac5-1624ac488d7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:21.974726 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1ef95245-3aba-45d1-8ac5-1624ac488d7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:21.980556 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ef95245-3aba-45d1-8ac5-1624ac488d7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:21.981003 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ef95245-3aba-45d1-8ac5-1624ac488d7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:21.981782 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ef95245-3aba-45d1-8ac5-1624ac488d7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:21.982217 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1ef95245-3aba-45d1-8ac5-1624ac488d7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:22.166205 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8b41d32d-40cc-4bff-9868-bccc69162688 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:22.171205 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1ef95245-3aba-45d1-8ac5-1624ac488d7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:22.174481 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8b41d32d-40cc-4bff-9868-bccc69162688 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.216074 Nov 12 02:27:22.175142 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 145/256] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:21 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:22.178990 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1ef95245-3aba-45d1-8ac5-1624ac488d7b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.208636 Nov 12 02:27:22.179536 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 112/257] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:21 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:22.541867 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5c69b73b-30a5-4493-9d32-192970194fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:22.542519 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5c69b73b-30a5-4493-9d32-192970194fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:22.548558 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5c69b73b-30a5-4493-9d32-192970194fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:22.548948 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-35c88bbc-280a-4461-a00f-6ec03332bafa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:22.549054 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5c69b73b-30a5-4493-9d32-192970194fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:22.549585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-35c88bbc-280a-4461-a00f-6ec03332bafa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:22.549764 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5c69b73b-30a5-4493-9d32-192970194fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:22.550197 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5c69b73b-30a5-4493-9d32-192970194fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:22.555929 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-35c88bbc-280a-4461-a00f-6ec03332bafa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:22.556380 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-35c88bbc-280a-4461-a00f-6ec03332bafa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:22.557184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-35c88bbc-280a-4461-a00f-6ec03332bafa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:22.557618 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-35c88bbc-280a-4461-a00f-6ec03332bafa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:22.753798 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-35c88bbc-280a-4461-a00f-6ec03332bafa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:22.758480 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5c69b73b-30a5-4493-9d32-192970194fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:22.761475 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-35c88bbc-280a-4461-a00f-6ec03332bafa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:22.763207 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-35c88bbc-280a-4461-a00f-6ec03332bafa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:22.764319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-35c88bbc-280a-4461-a00f-6ec03332bafa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.219039 Nov 12 02:27:22.764874 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 113/258] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:22 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:22.765728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5c69b73b-30a5-4493-9d32-192970194fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.227500 Nov 12 02:27:22.766269 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 146/259] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:22 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:22.769362 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6fa3e89c-30a3-48f1-a4e3-8bd4356a58c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:22.769960 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6fa3e89c-30a3-48f1-a4e3-8bd4356a58c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:22.775967 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6fa3e89c-30a3-48f1-a4e3-8bd4356a58c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:22.776418 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6fa3e89c-30a3-48f1-a4e3-8bd4356a58c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:22.777184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6fa3e89c-30a3-48f1-a4e3-8bd4356a58c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:22.777613 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6fa3e89c-30a3-48f1-a4e3-8bd4356a58c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:22.905700 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6fa3e89c-30a3-48f1-a4e3-8bd4356a58c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:22.913001 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6fa3e89c-30a3-48f1-a4e3-8bd4356a58c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.147207 Nov 12 02:27:22.913561 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 114/260] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:22 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:23.190817 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b4f9ea76-c1b1-407b-a301-9c4bd7a2a433 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:23.191429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b4f9ea76-c1b1-407b-a301-9c4bd7a2a433 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:23.198624 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4f9ea76-c1b1-407b-a301-9c4bd7a2a433 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:23.199232 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4f9ea76-c1b1-407b-a301-9c4bd7a2a433 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:23.200042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4f9ea76-c1b1-407b-a301-9c4bd7a2a433 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:23.200489 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4f9ea76-c1b1-407b-a301-9c4bd7a2a433 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:23.200613 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c68abb79-611c-4c32-84fa-b0e1c7821fd7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:23.201160 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c68abb79-611c-4c32-84fa-b0e1c7821fd7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:23.207362 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c68abb79-611c-4c32-84fa-b0e1c7821fd7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:23.207818 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c68abb79-611c-4c32-84fa-b0e1c7821fd7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:23.208605 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c68abb79-611c-4c32-84fa-b0e1c7821fd7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:23.209039 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c68abb79-611c-4c32-84fa-b0e1c7821fd7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:23.416045 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c68abb79-611c-4c32-84fa-b0e1c7821fd7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:23.423839 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c68abb79-611c-4c32-84fa-b0e1c7821fd7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.231976 Nov 12 02:27:23.424158 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b4f9ea76-c1b1-407b-a301-9c4bd7a2a433 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:23.424682 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 115/261] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:23 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:23.432090 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b4f9ea76-c1b1-407b-a301-9c4bd7a2a433 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.244973 Nov 12 02:27:23.432642 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 147/262] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:23 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:23.782735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-beb5a83e-b8f7-4671-ad73-b6089df8e1a7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:23.783393 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5364f677-a726-47a4-8a3a-391d567b8196 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:23.783393 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5364f677-a726-47a4-8a3a-391d567b8196 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:23.783821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-beb5a83e-b8f7-4671-ad73-b6089df8e1a7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:23.789950 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-beb5a83e-b8f7-4671-ad73-b6089df8e1a7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:23.790109 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5364f677-a726-47a4-8a3a-391d567b8196 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:23.790467 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5364f677-a726-47a4-8a3a-391d567b8196 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:23.790561 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-beb5a83e-b8f7-4671-ad73-b6089df8e1a7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:23.791281 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5364f677-a726-47a4-8a3a-391d567b8196 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:23.791389 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-beb5a83e-b8f7-4671-ad73-b6089df8e1a7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:23.791713 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5364f677-a726-47a4-8a3a-391d567b8196 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:23.791818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-beb5a83e-b8f7-4671-ad73-b6089df8e1a7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:23.989863 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-beb5a83e-b8f7-4671-ad73-b6089df8e1a7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:23.993480 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5364f677-a726-47a4-8a3a-391d567b8196 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:23.997844 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-beb5a83e-b8f7-4671-ad73-b6089df8e1a7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.218740 Nov 12 02:27:23.998417 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 148/263] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:23 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:24.002806 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-58f29ef2-de4f-4335-9b1d-122ad70c8ea3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:24.003800 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-58f29ef2-de4f-4335-9b1d-122ad70c8ea3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:24.008131 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5364f677-a726-47a4-8a3a-391d567b8196 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:24.009671 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5364f677-a726-47a4-8a3a-391d567b8196 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:24.010943 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5364f677-a726-47a4-8a3a-391d567b8196 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.231848 Nov 12 02:27:24.011681 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 116/264] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:23 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:24.013442 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58f29ef2-de4f-4335-9b1d-122ad70c8ea3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:24.014081 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58f29ef2-de4f-4335-9b1d-122ad70c8ea3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:24.015444 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58f29ef2-de4f-4335-9b1d-122ad70c8ea3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:24.015895 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58f29ef2-de4f-4335-9b1d-122ad70c8ea3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:24.144544 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-58f29ef2-de4f-4335-9b1d-122ad70c8ea3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:24.151895 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-58f29ef2-de4f-4335-9b1d-122ad70c8ea3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.152497 Nov 12 02:27:24.152483 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 149/265] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:23 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:24.441020 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8126f97e-bf4b-4f34-8f07-ee1a95f59eaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:24.441618 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8126f97e-bf4b-4f34-8f07-ee1a95f59eaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:24.447521 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8126f97e-bf4b-4f34-8f07-ee1a95f59eaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:24.447956 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8126f97e-bf4b-4f34-8f07-ee1a95f59eaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:24.448421 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8481804b-9ac3-413f-b500-f0dbc76c71d9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:24.448715 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8126f97e-bf4b-4f34-8f07-ee1a95f59eaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:24.449030 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8481804b-9ac3-413f-b500-f0dbc76c71d9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:24.449135 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8126f97e-bf4b-4f34-8f07-ee1a95f59eaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:24.454759 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8481804b-9ac3-413f-b500-f0dbc76c71d9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:24.455208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8481804b-9ac3-413f-b500-f0dbc76c71d9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:24.456018 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8481804b-9ac3-413f-b500-f0dbc76c71d9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:24.456457 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8481804b-9ac3-413f-b500-f0dbc76c71d9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:24.638917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8126f97e-bf4b-4f34-8f07-ee1a95f59eaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:24.643241 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8481804b-9ac3-413f-b500-f0dbc76c71d9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:24.646018 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8126f97e-bf4b-4f34-8f07-ee1a95f59eaf tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.208566 Nov 12 02:27:24.646587 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 117/266] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:24 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:24.650481 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8481804b-9ac3-413f-b500-f0dbc76c71d9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.205717 Nov 12 02:27:24.651058 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 150/267] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:24 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:25.015087 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-83e21d3d-986f-40f0-9dee-d3ee9f0d8dfe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:25.015840 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-83e21d3d-986f-40f0-9dee-d3ee9f0d8dfe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:25.022490 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-83e21d3d-986f-40f0-9dee-d3ee9f0d8dfe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:25.022963 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-83e21d3d-986f-40f0-9dee-d3ee9f0d8dfe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:25.023748 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-83e21d3d-986f-40f0-9dee-d3ee9f0d8dfe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:25.025158 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-83e21d3d-986f-40f0-9dee-d3ee9f0d8dfe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:25.029814 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5d1bb968-eb72-481d-be1f-0b9efadcc9df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:25.031006 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5d1bb968-eb72-481d-be1f-0b9efadcc9df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:25.037610 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d1bb968-eb72-481d-be1f-0b9efadcc9df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:25.038064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d1bb968-eb72-481d-be1f-0b9efadcc9df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:25.038892 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d1bb968-eb72-481d-be1f-0b9efadcc9df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:25.039321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d1bb968-eb72-481d-be1f-0b9efadcc9df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:25.227887 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-83e21d3d-986f-40f0-9dee-d3ee9f0d8dfe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:25.235434 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-83e21d3d-986f-40f0-9dee-d3ee9f0d8dfe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.224303 Nov 12 02:27:25.244454 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 118/268] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:25 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:25.244739 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5d1bb968-eb72-481d-be1f-0b9efadcc9df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:25.244852 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f6961091-f108-4627-99bd-f225b0829c54 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:25.244852 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f6961091-f108-4627-99bd-f225b0829c54 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:25.247629 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5d1bb968-eb72-481d-be1f-0b9efadcc9df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:25.249108 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5d1bb968-eb72-481d-be1f-0b9efadcc9df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:25.249702 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f6961091-f108-4627-99bd-f225b0829c54 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:25.250146 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f6961091-f108-4627-99bd-f225b0829c54 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:25.250253 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5d1bb968-eb72-481d-be1f-0b9efadcc9df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.224675 Nov 12 02:27:25.250719 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 151/269] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:25 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:25.250959 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f6961091-f108-4627-99bd-f225b0829c54 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:25.251389 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f6961091-f108-4627-99bd-f225b0829c54 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:25.389835 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f6961091-f108-4627-99bd-f225b0829c54 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:25.399150 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f6961091-f108-4627-99bd-f225b0829c54 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.159527 Nov 12 02:27:25.399731 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 119/270] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:25 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:25.663046 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-803bbef7-bb5d-44a0-9ef0-ef4dd0f05f53 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:25.663644 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-803bbef7-bb5d-44a0-9ef0-ef4dd0f05f53 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:25.667082 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4328bbba-2767-40d4-b49a-5e7b13022755 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:25.667840 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4328bbba-2767-40d4-b49a-5e7b13022755 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:25.669859 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-803bbef7-bb5d-44a0-9ef0-ef4dd0f05f53 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:25.670318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-803bbef7-bb5d-44a0-9ef0-ef4dd0f05f53 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:25.671287 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-803bbef7-bb5d-44a0-9ef0-ef4dd0f05f53 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:25.671732 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-803bbef7-bb5d-44a0-9ef0-ef4dd0f05f53 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:25.673635 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4328bbba-2767-40d4-b49a-5e7b13022755 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:25.674079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4328bbba-2767-40d4-b49a-5e7b13022755 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:25.674878 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4328bbba-2767-40d4-b49a-5e7b13022755 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:25.675309 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4328bbba-2767-40d4-b49a-5e7b13022755 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:25.870576 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-803bbef7-bb5d-44a0-9ef0-ef4dd0f05f53 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:25.873678 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4328bbba-2767-40d4-b49a-5e7b13022755 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:25.877899 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-803bbef7-bb5d-44a0-9ef0-ef4dd0f05f53 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.219062 Nov 12 02:27:25.878464 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 152/271] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:25 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:25.881319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4328bbba-2767-40d4-b49a-5e7b13022755 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.217735 Nov 12 02:27:25.881867 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 120/272] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:25 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:26.252169 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f5086cfd-8744-47ce-bd04-fdbb66de94a4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:26.252680 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f5086cfd-8744-47ce-bd04-fdbb66de94a4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:26.259296 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f5086cfd-8744-47ce-bd04-fdbb66de94a4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:26.259746 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f5086cfd-8744-47ce-bd04-fdbb66de94a4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:26.260524 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f5086cfd-8744-47ce-bd04-fdbb66de94a4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:26.260959 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f5086cfd-8744-47ce-bd04-fdbb66de94a4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:26.268167 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1d1976ce-694d-4e43-a8f0-9d74ccde42df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:26.268847 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1d1976ce-694d-4e43-a8f0-9d74ccde42df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:26.274468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d1976ce-694d-4e43-a8f0-9d74ccde42df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:26.274946 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d1976ce-694d-4e43-a8f0-9d74ccde42df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:26.275737 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d1976ce-694d-4e43-a8f0-9d74ccde42df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:26.276150 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d1976ce-694d-4e43-a8f0-9d74ccde42df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:26.461297 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f5086cfd-8744-47ce-bd04-fdbb66de94a4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:26.465281 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1d1976ce-694d-4e43-a8f0-9d74ccde42df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:26.469747 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f5086cfd-8744-47ce-bd04-fdbb66de94a4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.221255 Nov 12 02:27:26.470487 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 153/273] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:26 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:26.473744 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1d1976ce-694d-4e43-a8f0-9d74ccde42df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:26.475545 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1d1976ce-694d-4e43-a8f0-9d74ccde42df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:26.476537 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-725189d7-f838-40fd-9bf7-733258aa1df8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:26.477105 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1d1976ce-694d-4e43-a8f0-9d74ccde42df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.212371 Nov 12 02:27:26.477217 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-725189d7-f838-40fd-9bf7-733258aa1df8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:26.487503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-725189d7-f838-40fd-9bf7-733258aa1df8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:26.488276 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-725189d7-f838-40fd-9bf7-733258aa1df8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:26.489331 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 121/274] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:26 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:26.490107 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-725189d7-f838-40fd-9bf7-733258aa1df8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:26.490727 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-725189d7-f838-40fd-9bf7-733258aa1df8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:26.627881 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-725189d7-f838-40fd-9bf7-733258aa1df8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:26.639113 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-725189d7-f838-40fd-9bf7-733258aa1df8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.166366 Nov 12 02:27:26.639575 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 154/275] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:26 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:26.896620 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8a9191c2-6270-4a86-a8cd-623a94dcc3fc tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:26.897287 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8a9191c2-6270-4a86-a8cd-623a94dcc3fc tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:26.897404 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ca266b55-e5e1-4578-8015-1838aaedb42c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:26.897951 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ca266b55-e5e1-4578-8015-1838aaedb42c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:26.905022 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ca266b55-e5e1-4578-8015-1838aaedb42c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:26.905471 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ca266b55-e5e1-4578-8015-1838aaedb42c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:26.906333 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ca266b55-e5e1-4578-8015-1838aaedb42c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:26.906714 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ca266b55-e5e1-4578-8015-1838aaedb42c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:26.908497 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a9191c2-6270-4a86-a8cd-623a94dcc3fc tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:26.908939 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a9191c2-6270-4a86-a8cd-623a94dcc3fc tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:26.909715 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a9191c2-6270-4a86-a8cd-623a94dcc3fc tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:26.910141 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8a9191c2-6270-4a86-a8cd-623a94dcc3fc tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:27.097395 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ca266b55-e5e1-4578-8015-1838aaedb42c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:27.101665 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8a9191c2-6270-4a86-a8cd-623a94dcc3fc tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:27.104945 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ca266b55-e5e1-4578-8015-1838aaedb42c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.211739 Nov 12 02:27:27.105594 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 155/276] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:26 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:27.108768 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8a9191c2-6270-4a86-a8cd-623a94dcc3fc tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.217199 Nov 12 02:27:27.109326 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 122/277] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:26 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:27.486594 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3392b7ff-4d59-4cce-a61f-dfc4cc4df5d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:27.487139 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3392b7ff-4d59-4cce-a61f-dfc4cc4df5d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:27.493163 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3392b7ff-4d59-4cce-a61f-dfc4cc4df5d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:27.493604 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3392b7ff-4d59-4cce-a61f-dfc4cc4df5d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:27.494372 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3392b7ff-4d59-4cce-a61f-dfc4cc4df5d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:27.494818 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-51d078ea-e0cd-41f2-b649-1fe3776eea6e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:27.495232 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3392b7ff-4d59-4cce-a61f-dfc4cc4df5d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:27.495532 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-51d078ea-e0cd-41f2-b649-1fe3776eea6e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:27.501187 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-51d078ea-e0cd-41f2-b649-1fe3776eea6e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:27.501634 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-51d078ea-e0cd-41f2-b649-1fe3776eea6e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:27.502402 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-51d078ea-e0cd-41f2-b649-1fe3776eea6e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:27.502870 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-51d078ea-e0cd-41f2-b649-1fe3776eea6e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:27.691338 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-51d078ea-e0cd-41f2-b649-1fe3776eea6e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:27.699536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3392b7ff-4d59-4cce-a61f-dfc4cc4df5d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:27.700410 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-51d078ea-e0cd-41f2-b649-1fe3776eea6e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:27.701954 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-51d078ea-e0cd-41f2-b649-1fe3776eea6e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:27.703217 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-51d078ea-e0cd-41f2-b649-1fe3776eea6e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.212304 Nov 12 02:27:27.703777 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 123/278] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:27 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:27:27.707794 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3392b7ff-4d59-4cce-a61f-dfc4cc4df5d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.224887 Nov 12 02:27:27.708604 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 156/279] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:27 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:27.717307 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-db682efb-7c15-430f-ac91-3151c5740a2e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:27.717918 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-db682efb-7c15-430f-ac91-3151c5740a2e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:27.723776 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db682efb-7c15-430f-ac91-3151c5740a2e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:27.724296 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db682efb-7c15-430f-ac91-3151c5740a2e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:27.725763 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db682efb-7c15-430f-ac91-3151c5740a2e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:27.726192 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db682efb-7c15-430f-ac91-3151c5740a2e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:27.858081 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-db682efb-7c15-430f-ac91-3151c5740a2e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:27.865730 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-db682efb-7c15-430f-ac91-3151c5740a2e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.161030 Nov 12 02:27:27.866302 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 124/280] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:27 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:28.122356 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d529e630-10f0-455d-b08b-309a55212245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:28.122969 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d529e630-10f0-455d-b08b-309a55212245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:28.125523 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-044a0042-ca06-44b9-a657-64e1db3f0045 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:28.126134 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-044a0042-ca06-44b9-a657-64e1db3f0045 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:28.128797 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d529e630-10f0-455d-b08b-309a55212245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:28.129238 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d529e630-10f0-455d-b08b-309a55212245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:28.129992 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d529e630-10f0-455d-b08b-309a55212245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:28.130417 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d529e630-10f0-455d-b08b-309a55212245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:28.132113 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-044a0042-ca06-44b9-a657-64e1db3f0045 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:28.132566 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-044a0042-ca06-44b9-a657-64e1db3f0045 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:28.133336 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-044a0042-ca06-44b9-a657-64e1db3f0045 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:28.133770 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-044a0042-ca06-44b9-a657-64e1db3f0045 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:28.498369 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d529e630-10f0-455d-b08b-309a55212245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:28.501810 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-044a0042-ca06-44b9-a657-64e1db3f0045 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:28.505681 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d529e630-10f0-455d-b08b-309a55212245 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.386972 Nov 12 02:27:28.506248 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 157/281] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:28 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:28.509224 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-044a0042-ca06-44b9-a657-64e1db3f0045 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.387287 Nov 12 02:27:28.510021 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 125/282] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:28 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:28.721202 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ef9dbc27-0aa0-411e-bcd6-5d74fd7c41bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:28.721718 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ef9dbc27-0aa0-411e-bcd6-5d74fd7c41bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:28.724865 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-045d6015-75ff-48ea-9fc4-0d14e809e665 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:28.725526 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-045d6015-75ff-48ea-9fc4-0d14e809e665 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:28.730162 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ef9dbc27-0aa0-411e-bcd6-5d74fd7c41bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:28.730609 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ef9dbc27-0aa0-411e-bcd6-5d74fd7c41bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:28.731345 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-045d6015-75ff-48ea-9fc4-0d14e809e665 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:28.731429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ef9dbc27-0aa0-411e-bcd6-5d74fd7c41bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:28.731786 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-045d6015-75ff-48ea-9fc4-0d14e809e665 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:28.731864 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ef9dbc27-0aa0-411e-bcd6-5d74fd7c41bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:28.732529 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-045d6015-75ff-48ea-9fc4-0d14e809e665 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:28.732955 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-045d6015-75ff-48ea-9fc4-0d14e809e665 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:28.927015 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ef9dbc27-0aa0-411e-bcd6-5d74fd7c41bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:28.936705 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ef9dbc27-0aa0-411e-bcd6-5d74fd7c41bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:28.938201 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ef9dbc27-0aa0-411e-bcd6-5d74fd7c41bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:28.938472 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-045d6015-75ff-48ea-9fc4-0d14e809e665 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:28.939429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ef9dbc27-0aa0-411e-bcd6-5d74fd7c41bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.221990 Nov 12 02:27:28.939984 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 158/283] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:28 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:28.945177 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-accfc2bc-5466-40a2-9fb8-33eb415fdc5c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:28.945780 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-accfc2bc-5466-40a2-9fb8-33eb415fdc5c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:28.947605 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-045d6015-75ff-48ea-9fc4-0d14e809e665 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.226883 Nov 12 02:27:28.948452 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 126/284] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:28 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:28.951498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-accfc2bc-5466-40a2-9fb8-33eb415fdc5c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:28.951951 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-accfc2bc-5466-40a2-9fb8-33eb415fdc5c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:28.952728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-accfc2bc-5466-40a2-9fb8-33eb415fdc5c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:28.953164 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-accfc2bc-5466-40a2-9fb8-33eb415fdc5c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:29.080349 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-accfc2bc-5466-40a2-9fb8-33eb415fdc5c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:29.088150 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-accfc2bc-5466-40a2-9fb8-33eb415fdc5c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.147105 Nov 12 02:27:29.088712 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 159/285] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:28 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:29.522807 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1d97facc-7fd6-4cf1-96d0-8def5087959d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:29.523420 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1d97facc-7fd6-4cf1-96d0-8def5087959d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:29.524746 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-252695d0-928d-4d4d-bac1-4fbda7c96144 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:29.525478 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-252695d0-928d-4d4d-bac1-4fbda7c96144 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:29.529282 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d97facc-7fd6-4cf1-96d0-8def5087959d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:29.529732 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d97facc-7fd6-4cf1-96d0-8def5087959d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:29.530506 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d97facc-7fd6-4cf1-96d0-8def5087959d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:29.530960 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d97facc-7fd6-4cf1-96d0-8def5087959d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:29.531184 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-252695d0-928d-4d4d-bac1-4fbda7c96144 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:29.531634 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-252695d0-928d-4d4d-bac1-4fbda7c96144 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:29.532403 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-252695d0-928d-4d4d-bac1-4fbda7c96144 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:29.532835 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-252695d0-928d-4d4d-bac1-4fbda7c96144 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:29.721919 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1d97facc-7fd6-4cf1-96d0-8def5087959d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:29.729753 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-252695d0-928d-4d4d-bac1-4fbda7c96144 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:29.731133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1d97facc-7fd6-4cf1-96d0-8def5087959d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.212200 Nov 12 02:27:29.731712 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 127/286] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:29 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:29.737224 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-252695d0-928d-4d4d-bac1-4fbda7c96144 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.216046 Nov 12 02:27:29.737766 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 160/287] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:29 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:29.959585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-68c88fe1-7133-48ae-be24-68a1ea60aeb4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:29.960196 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-68c88fe1-7133-48ae-be24-68a1ea60aeb4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:29.964072 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e6fe51ed-c73a-4bcb-9c06-3d7ff473c608 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:29.964681 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e6fe51ed-c73a-4bcb-9c06-3d7ff473c608 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:29.965974 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-68c88fe1-7133-48ae-be24-68a1ea60aeb4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:29.966418 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-68c88fe1-7133-48ae-be24-68a1ea60aeb4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:29.967217 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-68c88fe1-7133-48ae-be24-68a1ea60aeb4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:29.967644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-68c88fe1-7133-48ae-be24-68a1ea60aeb4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:29.970417 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e6fe51ed-c73a-4bcb-9c06-3d7ff473c608 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:29.970902 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e6fe51ed-c73a-4bcb-9c06-3d7ff473c608 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:29.971676 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e6fe51ed-c73a-4bcb-9c06-3d7ff473c608 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:29.972112 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e6fe51ed-c73a-4bcb-9c06-3d7ff473c608 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:30.160990 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-68c88fe1-7133-48ae-be24-68a1ea60aeb4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:30.164470 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e6fe51ed-c73a-4bcb-9c06-3d7ff473c608 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:30.168911 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-68c88fe1-7133-48ae-be24-68a1ea60aeb4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:30.170477 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-68c88fe1-7133-48ae-be24-68a1ea60aeb4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:30.171627 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e6fe51ed-c73a-4bcb-9c06-3d7ff473c608 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.211091 Nov 12 02:27:30.171790 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-68c88fe1-7133-48ae-be24-68a1ea60aeb4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.216565 Nov 12 02:27:30.172376 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 161/288] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:29 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:30.172492 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 128/289] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:29 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:30.176917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-aea2319d-827f-48f9-a6c4-f30f0800e7e6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:30.177507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-aea2319d-827f-48f9-a6c4-f30f0800e7e6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:30.183038 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aea2319d-827f-48f9-a6c4-f30f0800e7e6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:30.183495 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aea2319d-827f-48f9-a6c4-f30f0800e7e6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:30.184268 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aea2319d-827f-48f9-a6c4-f30f0800e7e6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:30.184703 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aea2319d-827f-48f9-a6c4-f30f0800e7e6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:30.318457 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-aea2319d-827f-48f9-a6c4-f30f0800e7e6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:30.329129 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-aea2319d-827f-48f9-a6c4-f30f0800e7e6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.155883 Nov 12 02:27:30.329630 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 162/290] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:30 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:30.748599 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5daee422-5ba5-48ef-abca-dfc5583dad7f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:30.749212 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5daee422-5ba5-48ef-abca-dfc5583dad7f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:30.755242 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7da13aa0-483b-4b17-9a49-5dc4ffe57d67 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:30.755844 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7da13aa0-483b-4b17-9a49-5dc4ffe57d67 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:30.755952 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5daee422-5ba5-48ef-abca-dfc5583dad7f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:30.756379 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5daee422-5ba5-48ef-abca-dfc5583dad7f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:30.757187 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5daee422-5ba5-48ef-abca-dfc5583dad7f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:30.757624 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5daee422-5ba5-48ef-abca-dfc5583dad7f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:30.761475 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7da13aa0-483b-4b17-9a49-5dc4ffe57d67 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:30.761916 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7da13aa0-483b-4b17-9a49-5dc4ffe57d67 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:30.762684 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7da13aa0-483b-4b17-9a49-5dc4ffe57d67 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:30.763136 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7da13aa0-483b-4b17-9a49-5dc4ffe57d67 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:30.951377 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5daee422-5ba5-48ef-abca-dfc5583dad7f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:30.955788 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7da13aa0-483b-4b17-9a49-5dc4ffe57d67 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:30.960014 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5daee422-5ba5-48ef-abca-dfc5583dad7f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.214878 Nov 12 02:27:30.960849 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 129/291] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:30 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:30.964723 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7da13aa0-483b-4b17-9a49-5dc4ffe57d67 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.213683 Nov 12 02:27:30.965304 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 163/292] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:30 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:31.188595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1f46688d-c300-43d7-abae-2a00d274c265 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:31.189195 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1f46688d-c300-43d7-abae-2a00d274c265 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:31.195449 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1f46688d-c300-43d7-abae-2a00d274c265 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:31.195890 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1f46688d-c300-43d7-abae-2a00d274c265 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:31.196656 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1f46688d-c300-43d7-abae-2a00d274c265 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:31.197065 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-83adfb48-b10c-4b65-9b7e-ee4c69fd8cb8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:31.197164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1f46688d-c300-43d7-abae-2a00d274c265 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:31.197668 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-83adfb48-b10c-4b65-9b7e-ee4c69fd8cb8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:31.203299 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-83adfb48-b10c-4b65-9b7e-ee4c69fd8cb8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:31.203748 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-83adfb48-b10c-4b65-9b7e-ee4c69fd8cb8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:31.204572 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-83adfb48-b10c-4b65-9b7e-ee4c69fd8cb8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:31.205008 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-83adfb48-b10c-4b65-9b7e-ee4c69fd8cb8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:31.392378 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1f46688d-c300-43d7-abae-2a00d274c265 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:31.396321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-83adfb48-b10c-4b65-9b7e-ee4c69fd8cb8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:31.400367 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1f46688d-c300-43d7-abae-2a00d274c265 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.215379 Nov 12 02:27:31.400942 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 130/293] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:31 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:31.404708 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-83adfb48-b10c-4b65-9b7e-ee4c69fd8cb8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:31.405270 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-39b9b7ed-9b37-4f6c-b5fa-ec452d9ed299 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:31.405935 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-39b9b7ed-9b37-4f6c-b5fa-ec452d9ed299 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:31.406208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-83adfb48-b10c-4b65-9b7e-ee4c69fd8cb8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:31.407435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-83adfb48-b10c-4b65-9b7e-ee4c69fd8cb8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.214017 Nov 12 02:27:31.408045 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 164/294] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:31 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:31.411579 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-39b9b7ed-9b37-4f6c-b5fa-ec452d9ed299 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:31.412022 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-39b9b7ed-9b37-4f6c-b5fa-ec452d9ed299 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:31.412784 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-39b9b7ed-9b37-4f6c-b5fa-ec452d9ed299 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:31.413210 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-39b9b7ed-9b37-4f6c-b5fa-ec452d9ed299 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:31.541258 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-39b9b7ed-9b37-4f6c-b5fa-ec452d9ed299 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:31.548252 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-39b9b7ed-9b37-4f6c-b5fa-ec452d9ed299 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.146276 Nov 12 02:27:31.548803 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 131/295] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:31 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:31.980737 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-eb377137-0242-4515-838d-aae437ffeb26 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:31.981339 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-eb377137-0242-4515-838d-aae437ffeb26 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:31.981923 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a6a64a72-71dd-4200-ae99-cd07e538d68f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:31.982536 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a6a64a72-71dd-4200-ae99-cd07e538d68f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:31.987288 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eb377137-0242-4515-838d-aae437ffeb26 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:31.987734 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eb377137-0242-4515-838d-aae437ffeb26 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:31.988247 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6a64a72-71dd-4200-ae99-cd07e538d68f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:31.988532 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eb377137-0242-4515-838d-aae437ffeb26 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:31.989275 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6a64a72-71dd-4200-ae99-cd07e538d68f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:31.989504 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eb377137-0242-4515-838d-aae437ffeb26 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:31.990045 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6a64a72-71dd-4200-ae99-cd07e538d68f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:31.990476 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6a64a72-71dd-4200-ae99-cd07e538d68f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:32.184594 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-eb377137-0242-4515-838d-aae437ffeb26 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:32.192333 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a6a64a72-71dd-4200-ae99-cd07e538d68f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:32.199784 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a6a64a72-71dd-4200-ae99-cd07e538d68f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1314 microversion: 2.1 time: 0.221348 Nov 12 02:27:32.200540 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 132/296] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:31 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:32.204059 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-eb377137-0242-4515-838d-aae437ffeb26 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.215157 Nov 12 02:27:32.204787 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 165/297] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:31 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:32.416263 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-21339b10-5199-414f-86b3-25bee9a0c154 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:32.416862 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-21339b10-5199-414f-86b3-25bee9a0c154 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:32.422835 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-21339b10-5199-414f-86b3-25bee9a0c154 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:32.423286 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-21339b10-5199-414f-86b3-25bee9a0c154 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:32.424056 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-21339b10-5199-414f-86b3-25bee9a0c154 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:32.424487 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-21339b10-5199-414f-86b3-25bee9a0c154 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:32.425190 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b24f9d46-7f6e-42d5-ae33-657a5e772b81 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:32.425860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b24f9d46-7f6e-42d5-ae33-657a5e772b81 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:32.432369 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b24f9d46-7f6e-42d5-ae33-657a5e772b81 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:32.432819 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b24f9d46-7f6e-42d5-ae33-657a5e772b81 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:32.433601 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b24f9d46-7f6e-42d5-ae33-657a5e772b81 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:32.434027 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b24f9d46-7f6e-42d5-ae33-657a5e772b81 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:32.621520 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-21339b10-5199-414f-86b3-25bee9a0c154 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:32.625237 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b24f9d46-7f6e-42d5-ae33-657a5e772b81 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:32.634189 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b24f9d46-7f6e-42d5-ae33-657a5e772b81 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:32.635901 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b24f9d46-7f6e-42d5-ae33-657a5e772b81 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:32.636816 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b24f9d46-7f6e-42d5-ae33-657a5e772b81 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.215549 Nov 12 02:27:32.637375 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 166/298] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:32 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:32.641603 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-141a9e4f-3127-4a79-8e68-a0f0c0b5d5d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:32.642000 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-21339b10-5199-414f-86b3-25bee9a0c154 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.229140 Nov 12 02:27:32.642216 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-141a9e4f-3127-4a79-8e68-a0f0c0b5d5d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:32.643122 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 133/299] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:32 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:32.655664 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-141a9e4f-3127-4a79-8e68-a0f0c0b5d5d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:32.656113 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-141a9e4f-3127-4a79-8e68-a0f0c0b5d5d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:32.656889 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-141a9e4f-3127-4a79-8e68-a0f0c0b5d5d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:32.657447 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-141a9e4f-3127-4a79-8e68-a0f0c0b5d5d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:32.790318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-141a9e4f-3127-4a79-8e68-a0f0c0b5d5d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:32.797340 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-141a9e4f-3127-4a79-8e68-a0f0c0b5d5d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.158994 Nov 12 02:27:32.797897 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 167/300] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:32 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:33.227242 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-31aceb98-06c4-4316-a86f-ee672a2204c2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:33.233111 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0e6f27b0-6f26-4449-9665-79d35ae572da tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:33.233728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0e6f27b0-6f26-4449-9665-79d35ae572da tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:33.240008 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-31aceb98-06c4-4316-a86f-ee672a2204c2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:33.247770 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31aceb98-06c4-4316-a86f-ee672a2204c2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:33.248346 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31aceb98-06c4-4316-a86f-ee672a2204c2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:33.249585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31aceb98-06c4-4316-a86f-ee672a2204c2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:33.251981 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0e6f27b0-6f26-4449-9665-79d35ae572da tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:33.252430 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0e6f27b0-6f26-4449-9665-79d35ae572da tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:33.253216 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0e6f27b0-6f26-4449-9665-79d35ae572da tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:33.253650 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0e6f27b0-6f26-4449-9665-79d35ae572da tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:33.257588 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-31aceb98-06c4-4316-a86f-ee672a2204c2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:33.471294 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-31aceb98-06c4-4316-a86f-ee672a2204c2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:33.478974 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-31aceb98-06c4-4316-a86f-ee672a2204c2 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1500 microversion: 2.1 time: 0.264155 Nov 12 02:27:33.479312 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0e6f27b0-6f26-4449-9665-79d35ae572da tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:33.479536 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 134/301] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:33 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1500 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:33.486772 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0e6f27b0-6f26-4449-9665-79d35ae572da tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1318 microversion: 2.1 time: 0.269142 Nov 12 02:27:33.487587 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 168/302] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:33 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:33.654702 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-933d59a5-c76f-4934-8344-94b9064859b2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:33.655305 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-933d59a5-c76f-4934-8344-94b9064859b2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:33.658873 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-47d9b381-d719-4882-8b83-6a29413f0319 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:33.659593 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-47d9b381-d719-4882-8b83-6a29413f0319 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:33.661805 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-933d59a5-c76f-4934-8344-94b9064859b2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:33.662236 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-933d59a5-c76f-4934-8344-94b9064859b2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:33.663032 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-933d59a5-c76f-4934-8344-94b9064859b2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:33.663664 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-933d59a5-c76f-4934-8344-94b9064859b2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:33.666697 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-47d9b381-d719-4882-8b83-6a29413f0319 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:33.667335 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-47d9b381-d719-4882-8b83-6a29413f0319 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:33.668271 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-47d9b381-d719-4882-8b83-6a29413f0319 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:33.668709 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-47d9b381-d719-4882-8b83-6a29413f0319 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:33.884742 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-933d59a5-c76f-4934-8344-94b9064859b2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:33.889686 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-47d9b381-d719-4882-8b83-6a29413f0319 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:33.893966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-933d59a5-c76f-4934-8344-94b9064859b2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:33.895653 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-933d59a5-c76f-4934-8344-94b9064859b2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:33.896831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-933d59a5-c76f-4934-8344-94b9064859b2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1407 microversion: 2.20 time: 0.246686 Nov 12 02:27:33.901745 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-47d9b381-d719-4882-8b83-6a29413f0319 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.246588 Nov 12 02:27:33.902310 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 169/303] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:33 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:33.907272 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 135/304] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:33 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:33.914403 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3400176a-8790-4b88-92a7-642b78e68d1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:33.915046 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3400176a-8790-4b88-92a7-642b78e68d1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:33.920898 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3400176a-8790-4b88-92a7-642b78e68d1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:33.921342 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3400176a-8790-4b88-92a7-642b78e68d1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:33.922109 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3400176a-8790-4b88-92a7-642b78e68d1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:33.922533 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3400176a-8790-4b88-92a7-642b78e68d1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:34.050276 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3400176a-8790-4b88-92a7-642b78e68d1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:34.058047 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3400176a-8790-4b88-92a7-642b78e68d1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.154758 Nov 12 02:27:34.058603 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 170/305] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:33 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:34.504339 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7619c8d9-e43f-4ae6-bf46-376ccb1876ea tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:34.504949 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7619c8d9-e43f-4ae6-bf46-376ccb1876ea tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:34.510685 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7619c8d9-e43f-4ae6-bf46-376ccb1876ea tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:34.511131 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7619c8d9-e43f-4ae6-bf46-376ccb1876ea tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:34.511902 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7619c8d9-e43f-4ae6-bf46-376ccb1876ea tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:34.512334 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7619c8d9-e43f-4ae6-bf46-376ccb1876ea tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:34.642966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7619c8d9-e43f-4ae6-bf46-376ccb1876ea tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:34.650532 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7619c8d9-e43f-4ae6-bf46-376ccb1876ea tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1509 microversion: 2.1 time: 0.149814 Nov 12 02:27:34.651119 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 136/306] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:34 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:34.916119 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-bba6a82a-1b21-4a10-a04f-ad5bcc30a245 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:34.916749 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-bba6a82a-1b21-4a10-a04f-ad5bcc30a245 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:34.917926 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cc60429c-3d6d-4e2d-af29-ce8550bdd7ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:34.918537 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cc60429c-3d6d-4e2d-af29-ce8550bdd7ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:34.922966 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bba6a82a-1b21-4a10-a04f-ad5bcc30a245 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:34.923555 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bba6a82a-1b21-4a10-a04f-ad5bcc30a245 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:34.924569 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bba6a82a-1b21-4a10-a04f-ad5bcc30a245 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:34.924703 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cc60429c-3d6d-4e2d-af29-ce8550bdd7ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:34.925016 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cc60429c-3d6d-4e2d-af29-ce8550bdd7ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:34.925205 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bba6a82a-1b21-4a10-a04f-ad5bcc30a245 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:34.925879 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cc60429c-3d6d-4e2d-af29-ce8550bdd7ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:34.926319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cc60429c-3d6d-4e2d-af29-ce8550bdd7ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:35.161934 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cc60429c-3d6d-4e2d-af29-ce8550bdd7ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:35.169370 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cc60429c-3d6d-4e2d-af29-ce8550bdd7ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1321 microversion: 2.1 time: 0.254942 Nov 12 02:27:35.169941 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 137/307] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:34 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:35.174010 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-bba6a82a-1b21-4a10-a04f-ad5bcc30a245 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:35.174155 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-86ac23da-401f-40c5-82ed-d0bc7cc1b15a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:35.174786 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-86ac23da-401f-40c5-82ed-d0bc7cc1b15a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:35.181081 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-86ac23da-401f-40c5-82ed-d0bc7cc1b15a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:35.181751 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-86ac23da-401f-40c5-82ed-d0bc7cc1b15a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:35.182507 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-86ac23da-401f-40c5-82ed-d0bc7cc1b15a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:35.182963 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-86ac23da-401f-40c5-82ed-d0bc7cc1b15a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:35.183458 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-bba6a82a-1b21-4a10-a04f-ad5bcc30a245 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:35.184958 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-bba6a82a-1b21-4a10-a04f-ad5bcc30a245 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:35.186319 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-bba6a82a-1b21-4a10-a04f-ad5bcc30a245 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1598 microversion: 2.20 time: 0.275609 Nov 12 02:27:35.186911 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 171/308] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:27:34 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1598 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:27:35.205387 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-718d0452-4a4a-46d6-bd85-23bc7edbfbd2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:35.205879 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-718d0452-4a4a-46d6-bd85-23bc7edbfbd2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:35.212418 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-718d0452-4a4a-46d6-bd85-23bc7edbfbd2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:35.212896 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-718d0452-4a4a-46d6-bd85-23bc7edbfbd2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:35.213672 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-718d0452-4a4a-46d6-bd85-23bc7edbfbd2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:35.214118 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-718d0452-4a4a-46d6-bd85-23bc7edbfbd2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:35.344142 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-86ac23da-401f-40c5-82ed-d0bc7cc1b15a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:35.351371 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-86ac23da-401f-40c5-82ed-d0bc7cc1b15a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1360 microversion: 2.1 time: 0.180482 Nov 12 02:27:35.351935 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 138/309] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:35 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1360 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:35.357303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-718d0452-4a4a-46d6-bd85-23bc7edbfbd2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.155493 Nov 12 02:27:35.357905 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 172/310] 10.222.0.70 () {60 vars in 1315 bytes} [Fri Nov 12 02:27:35 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:27:36.186374 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-75a2fe14-d5d7-4b48-90ee-d7c03fff71ce tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:36.187078 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-75a2fe14-d5d7-4b48-90ee-d7c03fff71ce tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:36.193361 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-75a2fe14-d5d7-4b48-90ee-d7c03fff71ce tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:36.193804 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-75a2fe14-d5d7-4b48-90ee-d7c03fff71ce tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:36.194577 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-75a2fe14-d5d7-4b48-90ee-d7c03fff71ce tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:36.195031 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-75a2fe14-d5d7-4b48-90ee-d7c03fff71ce tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:36.368597 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a6e46122-2a8b-462b-ace7-3938c316db16 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:36.369727 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a6e46122-2a8b-462b-ace7-3938c316db16 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:36.376114 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a6e46122-2a8b-462b-ace7-3938c316db16 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:36.376595 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a6e46122-2a8b-462b-ace7-3938c316db16 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:36.377486 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a6e46122-2a8b-462b-ace7-3938c316db16 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:36.378018 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a6e46122-2a8b-462b-ace7-3938c316db16 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:36.498388 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-75a2fe14-d5d7-4b48-90ee-d7c03fff71ce tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:36.513344 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-75a2fe14-d5d7-4b48-90ee-d7c03fff71ce tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1513 microversion: 2.1 time: 0.330610 Nov 12 02:27:36.513918 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 139/311] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:36 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1513 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:36.531104 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9759269a-49ad-466b-8d7f-3a1bb63fea71 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:36.535328 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9759269a-49ad-466b-8d7f-3a1bb63fea71 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:36.543329 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9759269a-49ad-466b-8d7f-3a1bb63fea71 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:36.543788 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9759269a-49ad-466b-8d7f-3a1bb63fea71 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:36.544580 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9759269a-49ad-466b-8d7f-3a1bb63fea71 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:36.545012 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9759269a-49ad-466b-8d7f-3a1bb63fea71 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:36.614347 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-9759269a-49ad-466b-8d7f-3a1bb63fea71 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lazy-loading 'flavor' on Instance uuid 701cf4eb-6d33-4aa4-a762-2cae743dd618 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:27:36.629597 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a6e46122-2a8b-462b-ace7-3938c316db16 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:36.640378 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a6e46122-2a8b-462b-ace7-3938c316db16 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1545 microversion: 2.1 time: 0.275765 Nov 12 02:27:36.654243 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 173/312] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:36 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1545 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:36.659278 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1230d8d3-58e5-4357-acf9-a8f34adacae5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:36.659938 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1230d8d3-58e5-4357-acf9-a8f34adacae5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:36.670014 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1230d8d3-58e5-4357-acf9-a8f34adacae5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:36.670702 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1230d8d3-58e5-4357-acf9-a8f34adacae5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:36.672402 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1230d8d3-58e5-4357-acf9-a8f34adacae5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:36.674477 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1230d8d3-58e5-4357-acf9-a8f34adacae5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:36.756308 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9759269a-49ad-466b-8d7f-3a1bb63fea71 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "POST /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618/action" status: 200 len: 32 microversion: 2.1 time: 0.228566 Nov 12 02:27:36.757072 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 140/313] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:36 2021] POST /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:27:36.767941 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8100984a-abe4-4204-8c9d-755b4259b6ac tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:36.768288 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8100984a-abe4-4204-8c9d-755b4259b6ac tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:36.775498 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8100984a-abe4-4204-8c9d-755b4259b6ac tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:36.776233 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8100984a-abe4-4204-8c9d-755b4259b6ac tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:36.777184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8100984a-abe4-4204-8c9d-755b4259b6ac tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:36.777785 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8100984a-abe4-4204-8c9d-755b4259b6ac tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:36.798530 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1230d8d3-58e5-4357-acf9-a8f34adacae5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142852 Nov 12 02:27:36.799397 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 174/314] 10.222.0.70 () {58 vars in 1274 bytes} [Fri Nov 12 02:27:36 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:27:36.968238 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2e0aebfc-98dc-44fb-91a2-b951c4678431 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0836cde-5b2a-4d59-9ad7-de2f6c287b25"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:36.970132 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2e0aebfc-98dc-44fb-91a2-b951c4678431 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:36.992841 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2e0aebfc-98dc-44fb-91a2-b951c4678431 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:36.993350 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2e0aebfc-98dc-44fb-91a2-b951c4678431 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:36.994297 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2e0aebfc-98dc-44fb-91a2-b951c4678431 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:36.995073 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2e0aebfc-98dc-44fb-91a2-b951c4678431 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:37.054863 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8100984a-abe4-4204-8c9d-755b4259b6ac tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:37.068729 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8100984a-abe4-4204-8c9d-755b4259b6ac tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.306296 Nov 12 02:27:37.069319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 141/315] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:36 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:37.082877 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0194d677-68af-462b-9dde-e82e4949eb56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:37.084204 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0194d677-68af-462b-9dde-e82e4949eb56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:37.091858 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0194d677-68af-462b-9dde-e82e4949eb56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:37.092390 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0194d677-68af-462b-9dde-e82e4949eb56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:37.093792 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0194d677-68af-462b-9dde-e82e4949eb56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:37.094305 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0194d677-68af-462b-9dde-e82e4949eb56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:37.279535 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0194d677-68af-462b-9dde-e82e4949eb56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 14 microversion: 2.20 time: 0.208277 Nov 12 02:27:37.283140 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 142/316] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:37 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 14 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:37.287019 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-91967c5d-b489-4357-9ecb-3645095ccee5 req-2b55bead-a66f-4be3-a266-2cd6dcacb23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d16c68-a04c-4a32-a599-e202e6c64152", "tag": "6159a4de-08df-4c5b-afb6-bc1f4e2f213f"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:37.288623 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:27:37.288623 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:27:37.308908 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-91967c5d-b489-4357-9ecb-3645095ccee5 req-2b55bead-a66f-4be3-a266-2cd6dcacb23e service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:37.311784 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-91967c5d-b489-4357-9ecb-3645095ccee5 req-2b55bead-a66f-4be3-a266-2cd6dcacb23e service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:37.331116 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-91967c5d-b489-4357-9ecb-3645095ccee5 req-2b55bead-a66f-4be3-a266-2cd6dcacb23e service nova] Creating event network-changed:6159a4de-08df-4c5b-afb6-bc1f4e2f213f for instance 26d16c68-a04c-4a32-a599-e202e6c64152 on hv-cinder-80857 Nov 12 02:27:37.342850 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-91967c5d-b489-4357-9ecb-3645095ccee5 req-2b55bead-a66f-4be3-a266-2cd6dcacb23e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060637 Nov 12 02:27:37.343497 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 143/317] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:27:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:27:37.484080 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2e0aebfc-98dc-44fb-91a2-b951c4678431 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "POST /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.521488 Nov 12 02:27:37.492188 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 175/318] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:27:36 2021] POST /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432/os-volume_attachments => generated 194 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:27:38.089430 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1a98812d-6085-4387-89c0-e80637cf6c9b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:38.090435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1a98812d-6085-4387-89c0-e80637cf6c9b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:38.109416 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1a98812d-6085-4387-89c0-e80637cf6c9b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:38.110085 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1a98812d-6085-4387-89c0-e80637cf6c9b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:38.111125 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1a98812d-6085-4387-89c0-e80637cf6c9b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:38.111839 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1a98812d-6085-4387-89c0-e80637cf6c9b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:38.212531 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-bb74498e-edb8-4d3d-b672-ecf81500c889 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a63de7f3-2f98-4978-bfde-4a2efa5c7991"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:38.214564 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-bb74498e-edb8-4d3d-b672-ecf81500c889 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:38.222561 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bb74498e-edb8-4d3d-b672-ecf81500c889 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:38.223393 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bb74498e-edb8-4d3d-b672-ecf81500c889 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:38.224986 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bb74498e-edb8-4d3d-b672-ecf81500c889 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:38.225654 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bb74498e-edb8-4d3d-b672-ecf81500c889 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:38.357996 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1a98812d-6085-4387-89c0-e80637cf6c9b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:38.376880 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1a98812d-6085-4387-89c0-e80637cf6c9b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.295272 Nov 12 02:27:38.377468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 144/319] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:38 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:38.387394 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7fb9d5ad-0b85-4495-b1b3-36a9a9c3f42f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:38.388302 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7fb9d5ad-0b85-4495-b1b3-36a9a9c3f42f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:38.394253 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7fb9d5ad-0b85-4495-b1b3-36a9a9c3f42f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:38.394788 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7fb9d5ad-0b85-4495-b1b3-36a9a9c3f42f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:38.395562 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7fb9d5ad-0b85-4495-b1b3-36a9a9c3f42f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:38.396160 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7fb9d5ad-0b85-4495-b1b3-36a9a9c3f42f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:38.592082 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7fb9d5ad-0b85-4495-b1b3-36a9a9c3f42f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 14 microversion: 2.20 time: 0.211696 Nov 12 02:27:38.592868 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 145/320] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:38 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:38.747176 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-bb74498e-edb8-4d3d-b672-ecf81500c889 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "POST /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.542100 Nov 12 02:27:38.749077 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 176/321] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:27:38 2021] POST /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a/os-volume_attachments => generated 194 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:27:38.875962 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-04b6bc48-c223-4fd8-ab34-76fa6480b353 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:38.877608 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-429edb89-cc0b-4121-9995-12cdc0e27ac8 req-9dd4638a-b12b-4841-8b3f-9978a1ffcc61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1ce3bd-1739-49be-ab2e-e81c1026ae30", "tag": "2c2246ad-0135-4e41-9bee-c87015e386f7"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:38.879292 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:27:38.879292 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:27:38.883917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-04b6bc48-c223-4fd8-ab34-76fa6480b353 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:38.890952 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-04b6bc48-c223-4fd8-ab34-76fa6480b353 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:38.891243 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-04b6bc48-c223-4fd8-ab34-76fa6480b353 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:38.892023 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-04b6bc48-c223-4fd8-ab34-76fa6480b353 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:38.892454 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-04b6bc48-c223-4fd8-ab34-76fa6480b353 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:38.899742 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-429edb89-cc0b-4121-9995-12cdc0e27ac8 req-9dd4638a-b12b-4841-8b3f-9978a1ffcc61 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:38.900370 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-429edb89-cc0b-4121-9995-12cdc0e27ac8 req-9dd4638a-b12b-4841-8b3f-9978a1ffcc61 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:38.924053 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-429edb89-cc0b-4121-9995-12cdc0e27ac8 req-9dd4638a-b12b-4841-8b3f-9978a1ffcc61 service nova] Creating event network-changed:2c2246ad-0135-4e41-9bee-c87015e386f7 for instance 5c1ce3bd-1739-49be-ab2e-e81c1026ae30 on hv-cinder-80857 Nov 12 02:27:38.932484 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-429edb89-cc0b-4121-9995-12cdc0e27ac8 req-9dd4638a-b12b-4841-8b3f-9978a1ffcc61 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068699 Nov 12 02:27:38.934123 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 177/322] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:27:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:27:39.181135 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-04b6bc48-c223-4fd8-ab34-76fa6480b353 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 0.320236 Nov 12 02:27:39.184475 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 146/323] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:38 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:27:39.396886 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-cc9f4780-996f-48b9-a358-20344c50609e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:39.397605 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-cc9f4780-996f-48b9-a358-20344c50609e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:39.406051 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cc9f4780-996f-48b9-a358-20344c50609e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:39.406510 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cc9f4780-996f-48b9-a358-20344c50609e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:39.408704 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cc9f4780-996f-48b9-a358-20344c50609e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:39.409152 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cc9f4780-996f-48b9-a358-20344c50609e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:39.554890 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cc9f4780-996f-48b9-a358-20344c50609e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:39.563361 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-cc9f4780-996f-48b9-a358-20344c50609e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.173254 Nov 12 02:27:39.564235 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 178/324] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:39 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:39.604082 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ce7257ea-d543-42ba-b670-9490338a63ea tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:39.605085 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ce7257ea-d543-42ba-b670-9490338a63ea tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:39.611875 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce7257ea-d543-42ba-b670-9490338a63ea tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:39.612325 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce7257ea-d543-42ba-b670-9490338a63ea tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:39.613103 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce7257ea-d543-42ba-b670-9490338a63ea tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:39.613571 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce7257ea-d543-42ba-b670-9490338a63ea tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:39.783283 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ce7257ea-d543-42ba-b670-9490338a63ea tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 14 microversion: 2.20 time: 0.182881 Nov 12 02:27:39.784251 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 147/325] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:39 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:40.191778 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-58952044-2b9e-42de-95c0-c53f46e8e128 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:40.192735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-58952044-2b9e-42de-95c0-c53f46e8e128 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:40.199184 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58952044-2b9e-42de-95c0-c53f46e8e128 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:40.199627 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58952044-2b9e-42de-95c0-c53f46e8e128 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:40.200602 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58952044-2b9e-42de-95c0-c53f46e8e128 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:40.201038 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58952044-2b9e-42de-95c0-c53f46e8e128 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:40.323245 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-58952044-2b9e-42de-95c0-c53f46e8e128 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 0.134824 Nov 12 02:27:40.323861 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 179/326] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:40 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:27:40.587291 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c8bcd2cd-e58a-4958-83db-9b38973a4e5b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:40.588179 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c8bcd2cd-e58a-4958-83db-9b38973a4e5b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:40.596079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c8bcd2cd-e58a-4958-83db-9b38973a4e5b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:40.596543 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c8bcd2cd-e58a-4958-83db-9b38973a4e5b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:40.597362 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c8bcd2cd-e58a-4958-83db-9b38973a4e5b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:40.598369 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c8bcd2cd-e58a-4958-83db-9b38973a4e5b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:40.733898 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c8bcd2cd-e58a-4958-83db-9b38973a4e5b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:40.742308 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c8bcd2cd-e58a-4958-83db-9b38973a4e5b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.161028 Nov 12 02:27:40.743536 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 148/327] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:40 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:40.793966 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f9a988c0-943a-4944-9e3e-48645fb64b6f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:40.795209 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f9a988c0-943a-4944-9e3e-48645fb64b6f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:40.802954 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f9a988c0-943a-4944-9e3e-48645fb64b6f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:40.803453 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f9a988c0-943a-4944-9e3e-48645fb64b6f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:40.804236 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f9a988c0-943a-4944-9e3e-48645fb64b6f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:40.804672 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f9a988c0-943a-4944-9e3e-48645fb64b6f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:40.911711 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f9a988c0-943a-4944-9e3e-48645fb64b6f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 14 microversion: 2.20 time: 0.121820 Nov 12 02:27:40.912857 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 180/328] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:40 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:41.333469 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-22d2d600-c6c9-4e8a-831e-cc504fa0a663 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:41.334435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-22d2d600-c6c9-4e8a-831e-cc504fa0a663 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:41.341033 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22d2d600-c6c9-4e8a-831e-cc504fa0a663 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:41.341481 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22d2d600-c6c9-4e8a-831e-cc504fa0a663 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:41.342252 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22d2d600-c6c9-4e8a-831e-cc504fa0a663 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:41.342716 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22d2d600-c6c9-4e8a-831e-cc504fa0a663 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:41.442217 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-22d2d600-c6c9-4e8a-831e-cc504fa0a663 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 0.111841 Nov 12 02:27:41.442901 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 149/329] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:41 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:27:41.760587 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4adc7461-3d97-40fc-ab68-9864e39adade tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:41.761274 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4adc7461-3d97-40fc-ab68-9864e39adade tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:41.767874 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4adc7461-3d97-40fc-ab68-9864e39adade tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:41.768314 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4adc7461-3d97-40fc-ab68-9864e39adade tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:41.769107 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4adc7461-3d97-40fc-ab68-9864e39adade tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:41.770177 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4adc7461-3d97-40fc-ab68-9864e39adade tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:41.900357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4adc7461-3d97-40fc-ab68-9864e39adade tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:41.908022 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4adc7461-3d97-40fc-ab68-9864e39adade tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.151566 Nov 12 02:27:41.908580 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 181/330] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:41 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:41.923697 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2d4ffbe7-91bc-4198-86f3-efe77ec73bdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:41.924725 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2d4ffbe7-91bc-4198-86f3-efe77ec73bdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:41.932101 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2d4ffbe7-91bc-4198-86f3-efe77ec73bdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:41.932552 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2d4ffbe7-91bc-4198-86f3-efe77ec73bdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:41.933500 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2d4ffbe7-91bc-4198-86f3-efe77ec73bdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:41.934042 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2d4ffbe7-91bc-4198-86f3-efe77ec73bdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:42.065351 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2d4ffbe7-91bc-4198-86f3-efe77ec73bdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 14 microversion: 2.20 time: 0.145439 Nov 12 02:27:42.065897 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 150/331] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:41 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:42.453399 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-bb753fc2-81a0-4688-9e8a-e779d5a28100 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:42.454316 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-bb753fc2-81a0-4688-9e8a-e779d5a28100 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:42.460869 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bb753fc2-81a0-4688-9e8a-e779d5a28100 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:42.461566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bb753fc2-81a0-4688-9e8a-e779d5a28100 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:42.462462 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bb753fc2-81a0-4688-9e8a-e779d5a28100 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:42.462858 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bb753fc2-81a0-4688-9e8a-e779d5a28100 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:42.565494 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-bb753fc2-81a0-4688-9e8a-e779d5a28100 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 0.115866 Nov 12 02:27:42.566164 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 182/332] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:42 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:27:42.925174 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-36884994-8fb5-4437-9d9f-683e6450f97b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:42.926011 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-36884994-8fb5-4437-9d9f-683e6450f97b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:42.952559 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36884994-8fb5-4437-9d9f-683e6450f97b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:42.953007 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36884994-8fb5-4437-9d9f-683e6450f97b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:42.954014 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36884994-8fb5-4437-9d9f-683e6450f97b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:42.954435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36884994-8fb5-4437-9d9f-683e6450f97b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:43.077771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f80c1e3d-c287-4230-a1b6-d0911e94732d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:43.079448 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f80c1e3d-c287-4230-a1b6-d0911e94732d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:43.094896 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f80c1e3d-c287-4230-a1b6-d0911e94732d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:43.095570 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f80c1e3d-c287-4230-a1b6-d0911e94732d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:43.096679 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f80c1e3d-c287-4230-a1b6-d0911e94732d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:43.097144 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f80c1e3d-c287-4230-a1b6-d0911e94732d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:43.107843 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-36884994-8fb5-4437-9d9f-683e6450f97b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:43.117177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-36884994-8fb5-4437-9d9f-683e6450f97b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.196147 Nov 12 02:27:43.122729 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 151/333] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:42 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:43.250277 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f80c1e3d-c287-4230-a1b6-d0911e94732d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 14 microversion: 2.20 time: 0.177304 Nov 12 02:27:43.250928 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 183/334] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:43 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:43.577553 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f34a0f87-25f2-4c80-86e8-ca0b4b974d86 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:43.579047 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f34a0f87-25f2-4c80-86e8-ca0b4b974d86 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:43.586839 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f34a0f87-25f2-4c80-86e8-ca0b4b974d86 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:43.587453 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f34a0f87-25f2-4c80-86e8-ca0b4b974d86 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:43.588501 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f34a0f87-25f2-4c80-86e8-ca0b4b974d86 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:43.589065 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f34a0f87-25f2-4c80-86e8-ca0b4b974d86 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:43.699923 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f34a0f87-25f2-4c80-86e8-ca0b4b974d86 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 0.125851 Nov 12 02:27:43.700595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 152/335] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:43 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:27:44.136143 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9e9c1bde-1937-41ad-9394-caecb63185ae tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:44.137097 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9e9c1bde-1937-41ad-9394-caecb63185ae tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:44.156612 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9e9c1bde-1937-41ad-9394-caecb63185ae tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:44.157140 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9e9c1bde-1937-41ad-9394-caecb63185ae tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:44.159459 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9e9c1bde-1937-41ad-9394-caecb63185ae tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:44.160028 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9e9c1bde-1937-41ad-9394-caecb63185ae tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:44.262398 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b7a76d7a-6354-4bdf-a966-2df6653245e0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:44.264468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b7a76d7a-6354-4bdf-a966-2df6653245e0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:44.272994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7a76d7a-6354-4bdf-a966-2df6653245e0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:44.274020 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7a76d7a-6354-4bdf-a966-2df6653245e0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:44.275093 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7a76d7a-6354-4bdf-a966-2df6653245e0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:44.276207 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7a76d7a-6354-4bdf-a966-2df6653245e0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:44.409158 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9e9c1bde-1937-41ad-9394-caecb63185ae tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:44.414954 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b7a76d7a-6354-4bdf-a966-2df6653245e0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 14 microversion: 2.20 time: 0.157023 Nov 12 02:27:44.415855 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 153/336] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:44 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:44.422841 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9e9c1bde-1937-41ad-9394-caecb63185ae tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.291057 Nov 12 02:27:44.423485 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 184/337] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:44 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:44.712751 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-46dec15f-d5c3-4cd8-8b31-ff270211b559 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:44.714212 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-46dec15f-d5c3-4cd8-8b31-ff270211b559 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:44.721803 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46dec15f-d5c3-4cd8-8b31-ff270211b559 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:44.722581 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46dec15f-d5c3-4cd8-8b31-ff270211b559 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:44.723862 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46dec15f-d5c3-4cd8-8b31-ff270211b559 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:44.724761 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46dec15f-d5c3-4cd8-8b31-ff270211b559 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:44.869157 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-46dec15f-d5c3-4cd8-8b31-ff270211b559 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 0.159049 Nov 12 02:27:44.871040 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 154/338] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:44 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:27:45.427527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-868ec917-b32c-419b-88f7-e73d2a1a0884 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:45.428520 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-868ec917-b32c-419b-88f7-e73d2a1a0884 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:45.440397 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a118486c-fb17-4621-88b9-70482b21df1c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:45.441083 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a118486c-fb17-4621-88b9-70482b21df1c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:45.450749 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-868ec917-b32c-419b-88f7-e73d2a1a0884 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:45.451182 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-868ec917-b32c-419b-88f7-e73d2a1a0884 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:45.451968 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-868ec917-b32c-419b-88f7-e73d2a1a0884 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:45.455265 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-868ec917-b32c-419b-88f7-e73d2a1a0884 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:45.460493 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a118486c-fb17-4621-88b9-70482b21df1c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:45.463697 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a118486c-fb17-4621-88b9-70482b21df1c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:45.464749 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a118486c-fb17-4621-88b9-70482b21df1c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:45.465391 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a118486c-fb17-4621-88b9-70482b21df1c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:45.593563 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-868ec917-b32c-419b-88f7-e73d2a1a0884 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 14 microversion: 2.20 time: 0.171435 Nov 12 02:27:45.594533 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 185/339] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:45 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:45.734550 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a118486c-fb17-4621-88b9-70482b21df1c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:45.748012 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a118486c-fb17-4621-88b9-70482b21df1c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.311672 Nov 12 02:27:45.759490 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 155/340] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:45 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:27:45.897564 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a727706e-6b95-492f-8d20-6fdc7709f6fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:45.899016 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a727706e-6b95-492f-8d20-6fdc7709f6fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:45.906842 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a727706e-6b95-492f-8d20-6fdc7709f6fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:45.907600 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a727706e-6b95-492f-8d20-6fdc7709f6fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:45.908581 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a727706e-6b95-492f-8d20-6fdc7709f6fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:45.909208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a727706e-6b95-492f-8d20-6fdc7709f6fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:46.065629 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a727706e-6b95-492f-8d20-6fdc7709f6fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 0.186077 Nov 12 02:27:46.067430 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 186/341] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:45 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:27:46.605644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a13a3e09-5018-48f6-8c70-905934604c29 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:46.606764 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a13a3e09-5018-48f6-8c70-905934604c29 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:46.618975 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a13a3e09-5018-48f6-8c70-905934604c29 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:46.620331 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a13a3e09-5018-48f6-8c70-905934604c29 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:46.621971 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a13a3e09-5018-48f6-8c70-905934604c29 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:46.623332 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a13a3e09-5018-48f6-8c70-905934604c29 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:46.765675 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-14517f2d-69e8-4a52-8d66-7c3e5b9b2a40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:46.766821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-14517f2d-69e8-4a52-8d66-7c3e5b9b2a40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:46.774168 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-14517f2d-69e8-4a52-8d66-7c3e5b9b2a40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:46.776665 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a13a3e09-5018-48f6-8c70-905934604c29 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 14 microversion: 2.20 time: 0.175575 Nov 12 02:27:46.779528 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-14517f2d-69e8-4a52-8d66-7c3e5b9b2a40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:46.780062 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 156/342] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:46 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:46.787538 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-14517f2d-69e8-4a52-8d66-7c3e5b9b2a40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:46.787992 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-14517f2d-69e8-4a52-8d66-7c3e5b9b2a40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:47.077500 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d2118824-0501-4996-8a4f-71f55f3084dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:47.078589 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d2118824-0501-4996-8a4f-71f55f3084dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:47.088796 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-14517f2d-69e8-4a52-8d66-7c3e5b9b2a40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:47.090209 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2118824-0501-4996-8a4f-71f55f3084dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:47.090659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2118824-0501-4996-8a4f-71f55f3084dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:47.091681 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2118824-0501-4996-8a4f-71f55f3084dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:47.092278 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2118824-0501-4996-8a4f-71f55f3084dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:47.100849 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-14517f2d-69e8-4a52-8d66-7c3e5b9b2a40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.335892 Nov 12 02:27:47.103405 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 187/343] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:46 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:47.248312 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d2118824-0501-4996-8a4f-71f55f3084dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 0.174512 Nov 12 02:27:47.251629 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 157/344] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:47 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:27:47.788187 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4df2b175-ba77-4c72-9c56-a894f1e2c944 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:47.789130 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4df2b175-ba77-4c72-9c56-a894f1e2c944 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:47.796883 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4df2b175-ba77-4c72-9c56-a894f1e2c944 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:47.797680 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4df2b175-ba77-4c72-9c56-a894f1e2c944 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:47.798906 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4df2b175-ba77-4c72-9c56-a894f1e2c944 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:47.799544 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4df2b175-ba77-4c72-9c56-a894f1e2c944 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:47.908480 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4df2b175-ba77-4c72-9c56-a894f1e2c944 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 14 microversion: 2.20 time: 0.124565 Nov 12 02:27:47.909112 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 188/345] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:47 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:48.118983 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3b5e2300-2232-4377-986c-c5b51036aa40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:48.120866 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3b5e2300-2232-4377-986c-c5b51036aa40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:48.131872 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3b5e2300-2232-4377-986c-c5b51036aa40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:48.132803 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3b5e2300-2232-4377-986c-c5b51036aa40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:48.133622 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3b5e2300-2232-4377-986c-c5b51036aa40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:48.136506 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3b5e2300-2232-4377-986c-c5b51036aa40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:48.261154 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8e25cec0-21d1-4331-bb43-09c9a4e9175d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:48.262159 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8e25cec0-21d1-4331-bb43-09c9a4e9175d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:48.270306 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e25cec0-21d1-4331-bb43-09c9a4e9175d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:48.270817 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e25cec0-21d1-4331-bb43-09c9a4e9175d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:48.273345 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e25cec0-21d1-4331-bb43-09c9a4e9175d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:48.273802 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e25cec0-21d1-4331-bb43-09c9a4e9175d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:48.399227 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8e25cec0-21d1-4331-bb43-09c9a4e9175d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 0.143009 Nov 12 02:27:48.400044 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 189/346] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:48 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 12 02:27:48.452109 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3b5e2300-2232-4377-986c-c5b51036aa40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:48.460823 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3b5e2300-2232-4377-986c-c5b51036aa40 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.347096 Nov 12 02:27:48.465206 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 158/347] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:48 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:48.919024 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e8a96782-a600-4c0a-818f-11d526d32914 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:48.920093 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e8a96782-a600-4c0a-818f-11d526d32914 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:48.926984 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8a96782-a600-4c0a-818f-11d526d32914 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:48.927438 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8a96782-a600-4c0a-818f-11d526d32914 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:48.928223 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8a96782-a600-4c0a-818f-11d526d32914 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:48.928660 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8a96782-a600-4c0a-818f-11d526d32914 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:49.055840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e8a96782-a600-4c0a-818f-11d526d32914 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 14 microversion: 2.20 time: 0.140616 Nov 12 02:27:49.056543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 190/348] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:48 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:49.409256 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2864ef2d-44af-41c0-8e1b-f939eedc7a9e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:49.410968 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2864ef2d-44af-41c0-8e1b-f939eedc7a9e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:49.417780 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2864ef2d-44af-41c0-8e1b-f939eedc7a9e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:49.418222 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2864ef2d-44af-41c0-8e1b-f939eedc7a9e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:49.419013 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2864ef2d-44af-41c0-8e1b-f939eedc7a9e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:49.419706 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2864ef2d-44af-41c0-8e1b-f939eedc7a9e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:49.489771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8ca8df96-808c-46c8-a0b2-f96debff0200 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:49.490512 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8ca8df96-808c-46c8-a0b2-f96debff0200 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:49.505117 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8ca8df96-808c-46c8-a0b2-f96debff0200 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:49.507972 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8ca8df96-808c-46c8-a0b2-f96debff0200 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:49.513034 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8ca8df96-808c-46c8-a0b2-f96debff0200 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:49.517286 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8ca8df96-808c-46c8-a0b2-f96debff0200 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:49.580403 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2864ef2d-44af-41c0-8e1b-f939eedc7a9e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 0.174604 Nov 12 02:27:49.585363 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 159/349] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:49 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:27:49.779750 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8ca8df96-808c-46c8-a0b2-f96debff0200 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:49.788450 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8ca8df96-808c-46c8-a0b2-f96debff0200 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.310521 Nov 12 02:27:49.790133 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 191/350] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:49 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:50.067852 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-888d4df2-5186-4984-be26-5870fe913816 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:50.068792 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-888d4df2-5186-4984-be26-5870fe913816 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:50.076794 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-888d4df2-5186-4984-be26-5870fe913816 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:50.077327 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-888d4df2-5186-4984-be26-5870fe913816 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:50.078084 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-888d4df2-5186-4984-be26-5870fe913816 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:50.078519 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-888d4df2-5186-4984-be26-5870fe913816 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:50.198333 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-888d4df2-5186-4984-be26-5870fe913816 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 14 microversion: 2.20 time: 0.135195 Nov 12 02:27:50.199505 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 160/351] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:50 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:50.592647 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c26724f5-14df-4029-a09f-84b825c72214 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:50.593631 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c26724f5-14df-4029-a09f-84b825c72214 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:50.601212 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c26724f5-14df-4029-a09f-84b825c72214 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:50.602048 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c26724f5-14df-4029-a09f-84b825c72214 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:50.603144 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c26724f5-14df-4029-a09f-84b825c72214 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:50.603818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c26724f5-14df-4029-a09f-84b825c72214 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:50.716497 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c26724f5-14df-4029-a09f-84b825c72214 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 0.127410 Nov 12 02:27:50.717252 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 192/352] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:50 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:27:50.806321 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-74ba9052-2307-4809-a319-95e97c9e9af8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:50.807883 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-74ba9052-2307-4809-a319-95e97c9e9af8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:50.814888 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-74ba9052-2307-4809-a319-95e97c9e9af8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:50.815621 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-74ba9052-2307-4809-a319-95e97c9e9af8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:50.817159 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-74ba9052-2307-4809-a319-95e97c9e9af8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:50.817820 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-74ba9052-2307-4809-a319-95e97c9e9af8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:50.982004 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-74ba9052-2307-4809-a319-95e97c9e9af8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:50.991989 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-74ba9052-2307-4809-a319-95e97c9e9af8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.189710 Nov 12 02:27:50.993451 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 161/353] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:50 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:51.211259 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4e4c72cd-aa08-4c4a-9164-ab4d56acdf62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:51.213321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4e4c72cd-aa08-4c4a-9164-ab4d56acdf62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:51.223692 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e4c72cd-aa08-4c4a-9164-ab4d56acdf62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:51.224823 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e4c72cd-aa08-4c4a-9164-ab4d56acdf62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:51.226237 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e4c72cd-aa08-4c4a-9164-ab4d56acdf62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:51.227297 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e4c72cd-aa08-4c4a-9164-ab4d56acdf62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:51.731691 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a16b0cfa-984c-4f07-be6c-41929b745c58 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:51.733359 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a16b0cfa-984c-4f07-be6c-41929b745c58 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:51.750185 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a16b0cfa-984c-4f07-be6c-41929b745c58 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:51.750637 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a16b0cfa-984c-4f07-be6c-41929b745c58 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:51.752074 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a16b0cfa-984c-4f07-be6c-41929b745c58 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:51.752521 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a16b0cfa-984c-4f07-be6c-41929b745c58 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:55.815438 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4e4c72cd-aa08-4c4a-9164-ab4d56acdf62 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 16120 microversion: 2.20 time: 4.609426 Nov 12 02:27:55.816093 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 193/354] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:51 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 16120 bytes in 4611 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:27:55.821376 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-19eec285-d008-47e3-8d7e-cf5ef22dc7de tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:55.822902 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-19eec285-d008-47e3-8d7e-cf5ef22dc7de tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:55.829861 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-19eec285-d008-47e3-8d7e-cf5ef22dc7de tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:55.830309 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-19eec285-d008-47e3-8d7e-cf5ef22dc7de tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:55.831135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-19eec285-d008-47e3-8d7e-cf5ef22dc7de tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:55.831569 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-19eec285-d008-47e3-8d7e-cf5ef22dc7de tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:55.835624 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a16b0cfa-984c-4f07-be6c-41929b745c58 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 4.111053 Nov 12 02:27:55.836396 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 162/355] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:51 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 4113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 12 02:27:55.966029 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-19eec285-d008-47e3-8d7e-cf5ef22dc7de tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:55.973509 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-19eec285-d008-47e3-8d7e-cf5ef22dc7de tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.156254 Nov 12 02:27:55.974917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 194/356] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:55 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:56.013819 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dd095426-eab9-4ffa-bccd-26e4190c06c0 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Action: 'create', calling method: .version_select at 0x7fc0648844c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1761431138"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:56.027810 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-dd095426-eab9-4ffa-bccd-26e4190c06c0 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Getting quotas for project cdddbe78d48c4a9995c9d3e6c06bec3d. Resources: {'key_pairs'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:27:56.031907 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-dd095426-eab9-4ffa-bccd-26e4190c06c0 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Getting quotas for user e5cae9ebcf844041b45c03bfd1fddcf6 and project cdddbe78d48c4a9995c9d3e6c06bec3d. Resources: {'key_pairs'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:27:56.504133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-dd095426-eab9-4ffa-bccd-26e4190c06c0 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Getting quotas for project cdddbe78d48c4a9995c9d3e6c06bec3d. Resources: {'key_pairs'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:27:56.509534 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-dd095426-eab9-4ffa-bccd-26e4190c06c0 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Getting quotas for user e5cae9ebcf844041b45c03bfd1fddcf6 and project cdddbe78d48c4a9995c9d3e6c06bec3d. Resources: {'key_pairs'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:27:56.523391 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dd095426-eab9-4ffa-bccd-26e4190c06c0 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.685676 Nov 12 02:27:56.528825 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 163/357] 10.222.0.70 () {60 vars in 1157 bytes} [Fri Nov 12 02:27:55 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:56.829811 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3c82b773-9cca-4924-bbcb-306190af4ae1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:56.831354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3c82b773-9cca-4924-bbcb-306190af4ae1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:56.840482 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3c82b773-9cca-4924-bbcb-306190af4ae1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:56.841025 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3c82b773-9cca-4924-bbcb-306190af4ae1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:56.841871 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3c82b773-9cca-4924-bbcb-306190af4ae1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:56.842303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3c82b773-9cca-4924-bbcb-306190af4ae1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:56.847220 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-69554a90-c1c5-4fc7-8e75-3dcba0339218 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:56.849301 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-69554a90-c1c5-4fc7-8e75-3dcba0339218 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:56.861133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-69554a90-c1c5-4fc7-8e75-3dcba0339218 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:56.861708 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-69554a90-c1c5-4fc7-8e75-3dcba0339218 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:56.862612 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-69554a90-c1c5-4fc7-8e75-3dcba0339218 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:56.863169 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-69554a90-c1c5-4fc7-8e75-3dcba0339218 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:57.009013 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3c82b773-9cca-4924-bbcb-306190af4ae1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 17808 microversion: 2.20 time: 0.184717 Nov 12 02:27:57.009676 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 195/358] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:56 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 17808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:27:57.015456 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-364cbe18-29ea-42d4-918b-ddfa8fb75a2d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:57.016207 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-364cbe18-29ea-42d4-918b-ddfa8fb75a2d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:57.023708 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-364cbe18-29ea-42d4-918b-ddfa8fb75a2d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:57.024152 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-364cbe18-29ea-42d4-918b-ddfa8fb75a2d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:57.025123 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-364cbe18-29ea-42d4-918b-ddfa8fb75a2d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:57.025559 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-364cbe18-29ea-42d4-918b-ddfa8fb75a2d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:57.046865 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-69554a90-c1c5-4fc7-8e75-3dcba0339218 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 0.203896 Nov 12 02:27:57.047409 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 164/359] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:56 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:27:57.218923 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-364cbe18-29ea-42d4-918b-ddfa8fb75a2d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:57.226553 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-364cbe18-29ea-42d4-918b-ddfa8fb75a2d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.215295 Nov 12 02:27:57.227391 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 196/360] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:57 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:58.022451 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cd91b394-1733-46e5-8f52-7b95753510f9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:58.023483 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cd91b394-1733-46e5-8f52-7b95753510f9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:58.030062 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd91b394-1733-46e5-8f52-7b95753510f9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:58.030501 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd91b394-1733-46e5-8f52-7b95753510f9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:58.031511 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd91b394-1733-46e5-8f52-7b95753510f9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:58.031954 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd91b394-1733-46e5-8f52-7b95753510f9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:58.057518 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-66a2aa22-7a43-4c81-b907-14ced694f094 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:58.059167 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-66a2aa22-7a43-4c81-b907-14ced694f094 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:58.071136 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-66a2aa22-7a43-4c81-b907-14ced694f094 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:58.071595 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-66a2aa22-7a43-4c81-b907-14ced694f094 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:58.072401 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-66a2aa22-7a43-4c81-b907-14ced694f094 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:58.072981 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-66a2aa22-7a43-4c81-b907-14ced694f094 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:58.261278 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-66a2aa22-7a43-4c81-b907-14ced694f094 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 14 microversion: 2.1 time: 0.207299 Nov 12 02:27:58.262822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 197/361] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:58 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 12 02:27:58.267489 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3ab24019-5065-4f4e-b935-7aa12885a394 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:27:58.268357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3ab24019-5065-4f4e-b935-7aa12885a394 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:58.276232 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ab24019-5065-4f4e-b935-7aa12885a394 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:58.276696 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ab24019-5065-4f4e-b935-7aa12885a394 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:58.277483 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ab24019-5065-4f4e-b935-7aa12885a394 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:58.277967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ab24019-5065-4f4e-b935-7aa12885a394 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:58.306570 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cd91b394-1733-46e5-8f52-7b95753510f9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 19342 microversion: 2.20 time: 0.288078 Nov 12 02:27:58.311583 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 165/362] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:58 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 19342 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:27:58.429778 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3ab24019-5065-4f4e-b935-7aa12885a394 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:27:58.437631 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3ab24019-5065-4f4e-b935-7aa12885a394 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.174346 Nov 12 02:27:58.438407 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 198/363] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:27:58 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:27:59.274810 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4fb57be0-faf6-4061-a3fc-3d744d729b69 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:59.277430 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4fb57be0-faf6-4061-a3fc-3d744d729b69 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:59.285888 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fb57be0-faf6-4061-a3fc-3d744d729b69 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:59.286359 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fb57be0-faf6-4061-a3fc-3d744d729b69 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:59.287913 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fb57be0-faf6-4061-a3fc-3d744d729b69 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:59.288350 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fb57be0-faf6-4061-a3fc-3d744d729b69 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:59.323092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-85eaa8ed-7100-4e6b-bcc0-cdb594471550 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:27:59.325173 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-85eaa8ed-7100-4e6b-bcc0-cdb594471550 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:27:59.332992 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-85eaa8ed-7100-4e6b-bcc0-cdb594471550 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:59.333967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-85eaa8ed-7100-4e6b-bcc0-cdb594471550 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:27:59.334778 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-85eaa8ed-7100-4e6b-bcc0-cdb594471550 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:27:59.335213 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-85eaa8ed-7100-4e6b-bcc0-cdb594471550 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:08.784160 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4fb57be0-faf6-4061-a3fc-3d744d729b69 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 24580 microversion: 2.1 time: 9.514454 Nov 12 02:28:08.788110 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 166/364] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:27:59 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 24580 bytes in 9516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:28:08.789749 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d6479b62-6a09-44b2-b9b7-6e0ae8e5445a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:08.790446 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d6479b62-6a09-44b2-b9b7-6e0ae8e5445a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:08.797286 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6479b62-6a09-44b2-b9b7-6e0ae8e5445a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:08.797736 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6479b62-6a09-44b2-b9b7-6e0ae8e5445a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:08.798510 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6479b62-6a09-44b2-b9b7-6e0ae8e5445a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:08.798979 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6479b62-6a09-44b2-b9b7-6e0ae8e5445a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:08.945328 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d6479b62-6a09-44b2-b9b7-6e0ae8e5445a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:08.952604 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d6479b62-6a09-44b2-b9b7-6e0ae8e5445a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.166530 Nov 12 02:28:08.953168 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 167/365] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:08 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:09.327013 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-85eaa8ed-7100-4e6b-bcc0-cdb594471550 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 27481 microversion: 2.20 time: 10.010532 Nov 12 02:28:09.328347 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 199/366] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:27:59 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 27481 bytes in 10012 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:28:09.795897 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c8160ece-59f1-4059-82ea-3c6d7c555e9b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:09.797051 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c8160ece-59f1-4059-82ea-3c6d7c555e9b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:09.804756 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c8160ece-59f1-4059-82ea-3c6d7c555e9b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:09.805985 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c8160ece-59f1-4059-82ea-3c6d7c555e9b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:09.806814 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c8160ece-59f1-4059-82ea-3c6d7c555e9b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:09.807256 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c8160ece-59f1-4059-82ea-3c6d7c555e9b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:09.969742 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d39b8c66-35b9-40a0-b8a5-3e9514d63dfc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:09.970340 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d39b8c66-35b9-40a0-b8a5-3e9514d63dfc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:09.977840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d39b8c66-35b9-40a0-b8a5-3e9514d63dfc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:09.978279 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d39b8c66-35b9-40a0-b8a5-3e9514d63dfc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:09.979073 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d39b8c66-35b9-40a0-b8a5-3e9514d63dfc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:09.979507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d39b8c66-35b9-40a0-b8a5-3e9514d63dfc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:10.015079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c8160ece-59f1-4059-82ea-3c6d7c555e9b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 25682 microversion: 2.1 time: 0.222782 Nov 12 02:28:10.015957 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 168/367] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:09 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 25682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:10.111208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d39b8c66-35b9-40a0-b8a5-3e9514d63dfc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:10.119506 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d39b8c66-35b9-40a0-b8a5-3e9514d63dfc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.153839 Nov 12 02:28:10.120068 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 200/368] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:09 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:10.339221 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-18067724-c432-4421-abf9-6bb38675bb52 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:10.340228 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-18067724-c432-4421-abf9-6bb38675bb52 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:10.347041 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-18067724-c432-4421-abf9-6bb38675bb52 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:10.347491 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-18067724-c432-4421-abf9-6bb38675bb52 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:10.348266 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-18067724-c432-4421-abf9-6bb38675bb52 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:10.348725 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-18067724-c432-4421-abf9-6bb38675bb52 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:10.475390 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-849f6eaa-469c-4f5a-b86e-f57fba1bc9df tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:10.475998 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-849f6eaa-469c-4f5a-b86e-f57fba1bc9df tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:10.482762 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-849f6eaa-469c-4f5a-b86e-f57fba1bc9df tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:10.483481 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-849f6eaa-469c-4f5a-b86e-f57fba1bc9df tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:10.484306 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-849f6eaa-469c-4f5a-b86e-f57fba1bc9df tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:10.485064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-849f6eaa-469c-4f5a-b86e-f57fba1bc9df tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:10.503155 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-18067724-c432-4421-abf9-6bb38675bb52 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 27778 microversion: 2.20 time: 0.167705 Nov 12 02:28:10.503800 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 169/369] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:10 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 27778 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:10.513925 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-849f6eaa-469c-4f5a-b86e-f57fba1bc9df tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Going to try to terminate instance {{(pid=116099) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:28:10.613150 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-849f6eaa-469c-4f5a-b86e-f57fba1bc9df tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 204 len: 0 microversion: 2.1 time: 0.140312 Nov 12 02:28:10.614258 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 201/370] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:28:10 2021] DELETE /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 12 02:28:10.624878 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1da30899-bb06-46ba-a051-b51df7f6aa5b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:10.625483 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1da30899-bb06-46ba-a051-b51df7f6aa5b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:10.632878 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1da30899-bb06-46ba-a051-b51df7f6aa5b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:10.633323 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1da30899-bb06-46ba-a051-b51df7f6aa5b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:10.634095 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1da30899-bb06-46ba-a051-b51df7f6aa5b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:10.634550 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1da30899-bb06-46ba-a051-b51df7f6aa5b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:10.767235 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1da30899-bb06-46ba-a051-b51df7f6aa5b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:10.775104 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1da30899-bb06-46ba-a051-b51df7f6aa5b tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1552 microversion: 2.1 time: 0.155761 Nov 12 02:28:10.775657 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 170/371] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:10 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:11.027985 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3c54c954-81d2-4e29-b68b-237352dc64db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:11.029146 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3c54c954-81d2-4e29-b68b-237352dc64db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:11.037016 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3c54c954-81d2-4e29-b68b-237352dc64db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:11.037467 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3c54c954-81d2-4e29-b68b-237352dc64db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:11.038250 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3c54c954-81d2-4e29-b68b-237352dc64db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:11.038710 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3c54c954-81d2-4e29-b68b-237352dc64db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:11.136109 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-84bc874d-5c32-4a3d-80be-549246e2ff81 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:11.136768 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-84bc874d-5c32-4a3d-80be-549246e2ff81 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:11.143264 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84bc874d-5c32-4a3d-80be-549246e2ff81 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:11.143715 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84bc874d-5c32-4a3d-80be-549246e2ff81 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:11.144504 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84bc874d-5c32-4a3d-80be-549246e2ff81 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:11.144941 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84bc874d-5c32-4a3d-80be-549246e2ff81 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:11.156995 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3c54c954-81d2-4e29-b68b-237352dc64db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 26369 microversion: 2.1 time: 0.133703 Nov 12 02:28:11.157653 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 202/372] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:11 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 26369 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:11.273442 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-84bc874d-5c32-4a3d-80be-549246e2ff81 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:11.281571 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-84bc874d-5c32-4a3d-80be-549246e2ff81 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.149015 Nov 12 02:28:11.282060 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 171/373] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:11 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:11.516171 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f765c937-91bc-435d-81c6-81aa5954e770 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:11.517160 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f765c937-91bc-435d-81c6-81aa5954e770 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:11.524554 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f765c937-91bc-435d-81c6-81aa5954e770 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:11.525001 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f765c937-91bc-435d-81c6-81aa5954e770 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:11.525767 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f765c937-91bc-435d-81c6-81aa5954e770 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:11.526198 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f765c937-91bc-435d-81c6-81aa5954e770 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:11.792535 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2be54301-4544-4d64-8aa6-6f54791da633 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:11.793405 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2be54301-4544-4d64-8aa6-6f54791da633 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:11.800298 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2be54301-4544-4d64-8aa6-6f54791da633 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:11.800756 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2be54301-4544-4d64-8aa6-6f54791da633 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:11.801545 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2be54301-4544-4d64-8aa6-6f54791da633 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:11.801982 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2be54301-4544-4d64-8aa6-6f54791da633 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:11.934313 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2be54301-4544-4d64-8aa6-6f54791da633 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:11.943710 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2be54301-4544-4d64-8aa6-6f54791da633 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1552 microversion: 2.1 time: 0.154927 Nov 12 02:28:11.944480 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 172/374] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:11 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:12.168669 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-641722b4-9e2f-4843-8c5b-292dc167dfa9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:12.169704 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-641722b4-9e2f-4843-8c5b-292dc167dfa9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:12.175516 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-641722b4-9e2f-4843-8c5b-292dc167dfa9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:12.175967 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-641722b4-9e2f-4843-8c5b-292dc167dfa9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:12.176740 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-641722b4-9e2f-4843-8c5b-292dc167dfa9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:12.177711 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-641722b4-9e2f-4843-8c5b-292dc167dfa9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:17.429866 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f765c937-91bc-435d-81c6-81aa5954e770 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 27778 microversion: 2.20 time: 5.917560 Nov 12 02:28:17.430918 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 203/375] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:11 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 27778 bytes in 5919 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:17.435726 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1a9162aa-e695-4eb9-8497-05a466e70680 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:17.436165 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1a9162aa-e695-4eb9-8497-05a466e70680 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:17.443711 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a9162aa-e695-4eb9-8497-05a466e70680 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:17.444161 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a9162aa-e695-4eb9-8497-05a466e70680 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:17.444939 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a9162aa-e695-4eb9-8497-05a466e70680 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:17.445376 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a9162aa-e695-4eb9-8497-05a466e70680 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:17.463978 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-641722b4-9e2f-4843-8c5b-292dc167dfa9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 27864 microversion: 2.1 time: 5.298790 Nov 12 02:28:17.464668 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 173/376] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:12 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 27864 bytes in 5300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:28:17.469610 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-be50b52c-47b9-4767-afdb-c7df991e8ea7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:17.470304 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-be50b52c-47b9-4767-afdb-c7df991e8ea7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:17.484027 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be50b52c-47b9-4767-afdb-c7df991e8ea7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:17.484484 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be50b52c-47b9-4767-afdb-c7df991e8ea7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:17.485279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be50b52c-47b9-4767-afdb-c7df991e8ea7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:17.485719 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be50b52c-47b9-4767-afdb-c7df991e8ea7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:17.664453 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1a9162aa-e695-4eb9-8497-05a466e70680 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:17.668631 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be50b52c-47b9-4767-afdb-c7df991e8ea7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:17.672041 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1a9162aa-e695-4eb9-8497-05a466e70680 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.240354 Nov 12 02:28:17.672693 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 204/377] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:17 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:17.676363 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-be50b52c-47b9-4767-afdb-c7df991e8ea7 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1552 microversion: 2.1 time: 0.210642 Nov 12 02:28:17.676920 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 174/378] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:17 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1552 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:18.442449 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6ec608e2-71d2-4cb5-bcb1-6e9816cf79d6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:18.444034 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6ec608e2-71d2-4cb5-bcb1-6e9816cf79d6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:18.450103 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ec608e2-71d2-4cb5-bcb1-6e9816cf79d6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:18.450546 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ec608e2-71d2-4cb5-bcb1-6e9816cf79d6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:18.451341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ec608e2-71d2-4cb5-bcb1-6e9816cf79d6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:18.451772 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ec608e2-71d2-4cb5-bcb1-6e9816cf79d6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:18.474941 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2bd37536-be1d-4a73-8bbc-6958fdc19e21 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:18.475858 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2bd37536-be1d-4a73-8bbc-6958fdc19e21 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:18.482371 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2bd37536-be1d-4a73-8bbc-6958fdc19e21 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:18.482865 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2bd37536-be1d-4a73-8bbc-6958fdc19e21 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:18.483650 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2bd37536-be1d-4a73-8bbc-6958fdc19e21 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:18.484081 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2bd37536-be1d-4a73-8bbc-6958fdc19e21 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:18.659046 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6ec608e2-71d2-4cb5-bcb1-6e9816cf79d6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 27778 microversion: 2.20 time: 0.220098 Nov 12 02:28:18.659692 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 205/379] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:18 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 27778 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:18.684406 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2bd37536-be1d-4a73-8bbc-6958fdc19e21 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 27930 microversion: 2.1 time: 0.212856 Nov 12 02:28:18.685044 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 175/380] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:18 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 27930 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:18.690890 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b5d24042-b55e-47fe-aac8-b0ddf8a1b616 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:18.691646 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b5d24042-b55e-47fe-aac8-b0ddf8a1b616 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:18.695443 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-30461f33-74ff-4e72-aa48-25c377740c00 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:18.696222 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-30461f33-74ff-4e72-aa48-25c377740c00 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:18.699150 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b5d24042-b55e-47fe-aac8-b0ddf8a1b616 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:18.699593 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b5d24042-b55e-47fe-aac8-b0ddf8a1b616 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:18.700364 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b5d24042-b55e-47fe-aac8-b0ddf8a1b616 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:18.700792 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b5d24042-b55e-47fe-aac8-b0ddf8a1b616 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:18.702907 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-30461f33-74ff-4e72-aa48-25c377740c00 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:18.703362 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-30461f33-74ff-4e72-aa48-25c377740c00 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:18.704135 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-30461f33-74ff-4e72-aa48-25c377740c00 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:18.705918 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-30461f33-74ff-4e72-aa48-25c377740c00 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:18.917407 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b5d24042-b55e-47fe-aac8-b0ddf8a1b616 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:18.918987 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-30461f33-74ff-4e72-aa48-25c377740c00 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:18.928064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b5d24042-b55e-47fe-aac8-b0ddf8a1b616 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.240391 Nov 12 02:28:18.928273 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-30461f33-74ff-4e72-aa48-25c377740c00 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1552 microversion: 2.1 time: 0.237187 Nov 12 02:28:18.929070 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 176/381] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:18 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1552 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:18.936428 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 206/382] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:18 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:19.670831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5a1a0b99-b84f-4786-8889-b9039a6622b7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:19.671753 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5a1a0b99-b84f-4786-8889-b9039a6622b7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:19.678189 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a1a0b99-b84f-4786-8889-b9039a6622b7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:19.678638 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a1a0b99-b84f-4786-8889-b9039a6622b7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:19.679456 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a1a0b99-b84f-4786-8889-b9039a6622b7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:19.679893 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a1a0b99-b84f-4786-8889-b9039a6622b7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:19.695884 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e30452d1-7514-48d9-9bd0-d83f27034c52 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:19.696801 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e30452d1-7514-48d9-9bd0-d83f27034c52 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:19.703202 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e30452d1-7514-48d9-9bd0-d83f27034c52 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:19.703653 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e30452d1-7514-48d9-9bd0-d83f27034c52 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:19.704428 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e30452d1-7514-48d9-9bd0-d83f27034c52 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:19.704860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e30452d1-7514-48d9-9bd0-d83f27034c52 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:19.891453 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5a1a0b99-b84f-4786-8889-b9039a6622b7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 27844 microversion: 2.20 time: 0.224156 Nov 12 02:28:19.892107 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 177/383] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:19 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 27844 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:19.909244 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e30452d1-7514-48d9-9bd0-d83f27034c52 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 27930 microversion: 2.1 time: 0.216979 Nov 12 02:28:19.909896 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 207/384] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:19 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 27930 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:28:19.951678 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ce9f64bb-1624-48f0-abed-4a1654b68039 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:19.952387 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ce9f64bb-1624-48f0-abed-4a1654b68039 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:19.953550 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8e779a9d-00d2-4437-aa1f-880b396e4f62 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:19.954326 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8e779a9d-00d2-4437-aa1f-880b396e4f62 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:19.960506 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce9f64bb-1624-48f0-abed-4a1654b68039 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:19.960954 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce9f64bb-1624-48f0-abed-4a1654b68039 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:19.962206 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce9f64bb-1624-48f0-abed-4a1654b68039 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:19.962654 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce9f64bb-1624-48f0-abed-4a1654b68039 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:19.962908 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e779a9d-00d2-4437-aa1f-880b396e4f62 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:19.963731 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e779a9d-00d2-4437-aa1f-880b396e4f62 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:19.965047 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e779a9d-00d2-4437-aa1f-880b396e4f62 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:19.965492 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e779a9d-00d2-4437-aa1f-880b396e4f62 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:20.209498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8e779a9d-00d2-4437-aa1f-880b396e4f62 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:20.212661 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ce9f64bb-1624-48f0-abed-4a1654b68039 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:20.216612 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8e779a9d-00d2-4437-aa1f-880b396e4f62 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.267363 Nov 12 02:28:20.217263 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 208/385] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:19 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:20.220761 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ce9f64bb-1624-48f0-abed-4a1654b68039 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1552 microversion: 2.1 time: 0.273162 Nov 12 02:28:20.221312 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 178/386] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:19 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1552 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:20.872914 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-2b6cffd0-4b9f-49c8-9473-84a35fbb10a6 req-049dc812-28e1-4052-a203-e0d54fd663e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8244b795-8dd2-43ee-a703-79b742cd5432", "name": "network-vif-deleted", "tag": "65d1110b-f099-4749-9cc9-cc0fbaf8af9c"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:20.875005 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:28:20.875005 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:28:20.884924 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-2b6cffd0-4b9f-49c8-9473-84a35fbb10a6 req-049dc812-28e1-4052-a203-e0d54fd663e6 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:20.885359 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-2b6cffd0-4b9f-49c8-9473-84a35fbb10a6 req-049dc812-28e1-4052-a203-e0d54fd663e6 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:20.896331 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-2b6cffd0-4b9f-49c8-9473-84a35fbb10a6 req-049dc812-28e1-4052-a203-e0d54fd663e6 service nova] Creating event network-vif-deleted:65d1110b-f099-4749-9cc9-cc0fbaf8af9c for instance 8244b795-8dd2-43ee-a703-79b742cd5432 on hv-cinder-80857 Nov 12 02:28:20.901452 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-2b6cffd0-4b9f-49c8-9473-84a35fbb10a6 req-049dc812-28e1-4052-a203-e0d54fd663e6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032410 Nov 12 02:28:20.902024 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 209/387] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:28:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:28:20.903062 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d9dfb595-236e-4f46-8251-7d42e074f2c6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:20.904083 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d9dfb595-236e-4f46-8251-7d42e074f2c6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:20.910427 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d9dfb595-236e-4f46-8251-7d42e074f2c6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:20.910904 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d9dfb595-236e-4f46-8251-7d42e074f2c6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:20.911896 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d9dfb595-236e-4f46-8251-7d42e074f2c6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:20.912324 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d9dfb595-236e-4f46-8251-7d42e074f2c6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:20.922749 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-35b05d5e-764a-474a-b5a5-146a437825b6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:20.923932 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-35b05d5e-764a-474a-b5a5-146a437825b6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:20.934071 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35b05d5e-764a-474a-b5a5-146a437825b6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:20.934702 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35b05d5e-764a-474a-b5a5-146a437825b6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:20.935499 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35b05d5e-764a-474a-b5a5-146a437825b6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:20.936189 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35b05d5e-764a-474a-b5a5-146a437825b6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:21.060595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d9dfb595-236e-4f46-8251-7d42e074f2c6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28022 microversion: 2.20 time: 0.160980 Nov 12 02:28:21.061164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 179/388] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:20 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28022 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:28:21.103896 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-35b05d5e-764a-474a-b5a5-146a437825b6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28046 microversion: 2.1 time: 0.185203 Nov 12 02:28:21.104560 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 210/389] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:20 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28046 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:21.237795 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-82db9bce-22e9-4ebd-bd29-3e890ed61437 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:21.238578 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-82db9bce-22e9-4ebd-bd29-3e890ed61437 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:21.242814 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-baa48943-a1ae-4ec9-a6d9-031cabffa4d7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:21.243507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-baa48943-a1ae-4ec9-a6d9-031cabffa4d7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:21.246343 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82db9bce-22e9-4ebd-bd29-3e890ed61437 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:21.246818 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82db9bce-22e9-4ebd-bd29-3e890ed61437 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:21.247600 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82db9bce-22e9-4ebd-bd29-3e890ed61437 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:21.248036 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82db9bce-22e9-4ebd-bd29-3e890ed61437 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:21.249995 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-baa48943-a1ae-4ec9-a6d9-031cabffa4d7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:21.250445 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-baa48943-a1ae-4ec9-a6d9-031cabffa4d7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:21.251235 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-baa48943-a1ae-4ec9-a6d9-031cabffa4d7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:21.251657 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-baa48943-a1ae-4ec9-a6d9-031cabffa4d7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:21.316728 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-82db9bce-22e9-4ebd-bd29-3e890ed61437 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:21.327630 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-82db9bce-22e9-4ebd-bd29-3e890ed61437 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1345 microversion: 2.1 time: 0.094051 Nov 12 02:28:21.328211 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 180/390] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:21 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:21.435510 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-baa48943-a1ae-4ec9-a6d9-031cabffa4d7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:21.444186 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-baa48943-a1ae-4ec9-a6d9-031cabffa4d7 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.206555 Nov 12 02:28:21.444679 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 211/391] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:21 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:22.072531 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9c495568-bcdb-46c5-a68a-05e542d35639 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:22.073390 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9c495568-bcdb-46c5-a68a-05e542d35639 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:22.079634 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c495568-bcdb-46c5-a68a-05e542d35639 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:22.080082 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c495568-bcdb-46c5-a68a-05e542d35639 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:22.080859 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c495568-bcdb-46c5-a68a-05e542d35639 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:22.081299 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c495568-bcdb-46c5-a68a-05e542d35639 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:22.115060 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-922ea462-9bb0-4016-aa83-a62169354b5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:22.116016 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-922ea462-9bb0-4016-aa83-a62169354b5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:22.122603 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-922ea462-9bb0-4016-aa83-a62169354b5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:22.123075 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-922ea462-9bb0-4016-aa83-a62169354b5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:22.123851 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-922ea462-9bb0-4016-aa83-a62169354b5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:22.124915 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-922ea462-9bb0-4016-aa83-a62169354b5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:22.228521 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9c495568-bcdb-46c5-a68a-05e542d35639 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.159556 Nov 12 02:28:22.229355 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 181/392] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:22 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:22.291717 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-922ea462-9bb0-4016-aa83-a62169354b5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28174 microversion: 2.1 time: 0.180174 Nov 12 02:28:22.292354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 212/393] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:22 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28174 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:28:22.345454 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-43df819b-cd48-4d37-a2ea-75215ae5daf1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:22.346046 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-43df819b-cd48-4d37-a2ea-75215ae5daf1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:22.352800 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-43df819b-cd48-4d37-a2ea-75215ae5daf1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:22.353242 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-43df819b-cd48-4d37-a2ea-75215ae5daf1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:22.354000 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-43df819b-cd48-4d37-a2ea-75215ae5daf1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:22.354428 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-43df819b-cd48-4d37-a2ea-75215ae5daf1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:22.387696 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-43df819b-cd48-4d37-a2ea-75215ae5daf1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:22.388140 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-43df819b-cd48-4d37-a2ea-75215ae5daf1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:22.388582 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-43df819b-cd48-4d37-a2ea-75215ae5daf1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lazy-loading 'fault' on Instance uuid 8244b795-8dd2-43ee-a703-79b742cd5432 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:28:22.433322 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-43df819b-cd48-4d37-a2ea-75215ae5daf1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4448dae2a5949de870daa9501bfaa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913792060b1047f18c5dad6b397f1791', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:22.442073 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-43df819b-cd48-4d37-a2ea-75215ae5daf1 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 200 len: 1350 microversion: 2.1 time: 0.100651 Nov 12 02:28:22.443228 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 182/394] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:22 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:22.464269 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2f025e62-3db3-4ea9-ad81-caaa2a742816 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:22.465306 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2f025e62-3db3-4ea9-ad81-caaa2a742816 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:22.472409 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2f025e62-3db3-4ea9-ad81-caaa2a742816 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:22.472855 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2f025e62-3db3-4ea9-ad81-caaa2a742816 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:22.473676 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2f025e62-3db3-4ea9-ad81-caaa2a742816 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:22.474287 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2f025e62-3db3-4ea9-ad81-caaa2a742816 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:22.615254 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-2f025e62-3db3-4ea9-ad81-caaa2a742816 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:22.623071 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2f025e62-3db3-4ea9-ad81-caaa2a742816 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.164508 Nov 12 02:28:22.623902 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 213/395] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:22 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:23.240319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-350148cc-f923-45bf-8563-0abb38c16213 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:23.241241 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-350148cc-f923-45bf-8563-0abb38c16213 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:23.250170 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-350148cc-f923-45bf-8563-0abb38c16213 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:23.250621 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-350148cc-f923-45bf-8563-0abb38c16213 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:23.251422 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-350148cc-f923-45bf-8563-0abb38c16213 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:23.251860 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-350148cc-f923-45bf-8563-0abb38c16213 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:23.303362 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-48605657-d2d3-4c5c-8bbd-641ae279e532 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:23.304280 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-48605657-d2d3-4c5c-8bbd-641ae279e532 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:23.310582 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-48605657-d2d3-4c5c-8bbd-641ae279e532 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:23.311062 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-48605657-d2d3-4c5c-8bbd-641ae279e532 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:23.311840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-48605657-d2d3-4c5c-8bbd-641ae279e532 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:23.312273 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-48605657-d2d3-4c5c-8bbd-641ae279e532 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:23.347862 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-350148cc-f923-45bf-8563-0abb38c16213 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.111066 Nov 12 02:28:23.348528 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 183/396] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:23 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:28:23.430228 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-48605657-d2d3-4c5c-8bbd-641ae279e532 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.130201 Nov 12 02:28:23.430946 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 214/397] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:23 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:28:23.460791 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ce208d6b-8748-43a0-bf25-d77fb9490a28 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:23.461553 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ce208d6b-8748-43a0-bf25-d77fb9490a28 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:23.468783 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce208d6b-8748-43a0-bf25-d77fb9490a28 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:23.469185 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce208d6b-8748-43a0-bf25-d77fb9490a28 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:23.469594 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce208d6b-8748-43a0-bf25-d77fb9490a28 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:23.470033 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce208d6b-8748-43a0-bf25-d77fb9490a28 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:23.484603 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-ce208d6b-8748-43a0-bf25-d77fb9490a28 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] HTTP exception thrown: Instance 8244b795-8dd2-43ee-a703-79b742cd5432 could not be found. Nov 12 02:28:23.485223 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ce208d6b-8748-43a0-bf25-d77fb9490a28 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Returning 404 to user: Instance 8244b795-8dd2-43ee-a703-79b742cd5432 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:28:23.486108 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ce208d6b-8748-43a0-bf25-d77fb9490a28 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 404 len: 111 microversion: 2.1 time: 0.029899 Nov 12 02:28:23.486709 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 184/398] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:23 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:28:23.600504 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-eec636e5-a7c5-4f42-be6a-89b4439eecf6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:23.601622 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-eec636e5-a7c5-4f42-be6a-89b4439eecf6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:23.608701 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eec636e5-a7c5-4f42-be6a-89b4439eecf6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:23.609438 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eec636e5-a7c5-4f42-be6a-89b4439eecf6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:23.610360 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eec636e5-a7c5-4f42-be6a-89b4439eecf6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:23.610831 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eec636e5-a7c5-4f42-be6a-89b4439eecf6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:23.625735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-eec636e5-a7c5-4f42-be6a-89b4439eecf6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] HTTP exception thrown: Instance 8244b795-8dd2-43ee-a703-79b742cd5432 could not be found. Nov 12 02:28:23.626385 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-eec636e5-a7c5-4f42-be6a-89b4439eecf6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Returning 404 to user: Instance 8244b795-8dd2-43ee-a703-79b742cd5432 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:28:23.627248 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-eec636e5-a7c5-4f42-be6a-89b4439eecf6 tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031845 Nov 12 02:28:23.627804 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 215/399] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:28:23 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:28:23.640519 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-811aefe7-11e4-44be-8d05-3b7e3489f96e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:23.641393 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-811aefe7-11e4-44be-8d05-3b7e3489f96e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:23.647434 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-811aefe7-11e4-44be-8d05-3b7e3489f96e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:23.647886 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-811aefe7-11e4-44be-8d05-3b7e3489f96e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:23.648665 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-811aefe7-11e4-44be-8d05-3b7e3489f96e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:23.649100 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-811aefe7-11e4-44be-8d05-3b7e3489f96e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:23.811115 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-811aefe7-11e4-44be-8d05-3b7e3489f96e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:23.819189 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-811aefe7-11e4-44be-8d05-3b7e3489f96e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.182179 Nov 12 02:28:23.819763 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 185/400] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:23 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:24.359622 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8eaf8fe6-1c34-4bc8-99a2-056d2c0bd9c3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:24.360533 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8eaf8fe6-1c34-4bc8-99a2-056d2c0bd9c3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:24.368173 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8eaf8fe6-1c34-4bc8-99a2-056d2c0bd9c3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:24.368621 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8eaf8fe6-1c34-4bc8-99a2-056d2c0bd9c3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:24.369650 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8eaf8fe6-1c34-4bc8-99a2-056d2c0bd9c3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:24.370195 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8eaf8fe6-1c34-4bc8-99a2-056d2c0bd9c3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:24.442649 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-af4e1300-10eb-44ea-a7e9-0a54e2d44f2a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:24.443549 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-af4e1300-10eb-44ea-a7e9-0a54e2d44f2a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:24.450086 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-af4e1300-10eb-44ea-a7e9-0a54e2d44f2a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:24.450531 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-af4e1300-10eb-44ea-a7e9-0a54e2d44f2a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:24.451337 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-af4e1300-10eb-44ea-a7e9-0a54e2d44f2a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:24.451878 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-af4e1300-10eb-44ea-a7e9-0a54e2d44f2a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:27.756176 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8eaf8fe6-1c34-4bc8-99a2-056d2c0bd9c3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 3.399358 Nov 12 02:28:27.760403 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 216/401] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:24 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 3402 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:27.768881 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f1aa23d5-043d-432d-a6ee-7536ad62212c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:27.769427 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f1aa23d5-043d-432d-a6ee-7536ad62212c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:27.777986 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f1aa23d5-043d-432d-a6ee-7536ad62212c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:27.778429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f1aa23d5-043d-432d-a6ee-7536ad62212c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:27.779247 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f1aa23d5-043d-432d-a6ee-7536ad62212c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:27.779682 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f1aa23d5-043d-432d-a6ee-7536ad62212c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:27.932644 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f1aa23d5-043d-432d-a6ee-7536ad62212c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:27.940137 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f1aa23d5-043d-432d-a6ee-7536ad62212c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.175368 Nov 12 02:28:27.940702 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 217/402] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:27 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:28.767274 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-28287f86-1f8c-4156-85ad-a84c8fc4508c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:28.768179 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-28287f86-1f8c-4156-85ad-a84c8fc4508c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:28.775130 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-28287f86-1f8c-4156-85ad-a84c8fc4508c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:28.775571 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-28287f86-1f8c-4156-85ad-a84c8fc4508c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:28.776336 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-28287f86-1f8c-4156-85ad-a84c8fc4508c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:28.776764 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-28287f86-1f8c-4156-85ad-a84c8fc4508c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:28.908029 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-af4e1300-10eb-44ea-a7e9-0a54e2d44f2a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 4.468901 Nov 12 02:28:28.909223 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 186/403] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:24 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 4471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:28:28.958110 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-90ad18dd-2614-49fc-8b22-d2293366d874 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:28.959397 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-90ad18dd-2614-49fc-8b22-d2293366d874 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:28.966550 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90ad18dd-2614-49fc-8b22-d2293366d874 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:28.966970 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90ad18dd-2614-49fc-8b22-d2293366d874 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:28.967745 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90ad18dd-2614-49fc-8b22-d2293366d874 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:28.968180 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90ad18dd-2614-49fc-8b22-d2293366d874 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:29.101776 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-90ad18dd-2614-49fc-8b22-d2293366d874 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:29.113620 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-90ad18dd-2614-49fc-8b22-d2293366d874 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.159471 Nov 12 02:28:29.115150 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 187/404] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:28 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:29.920285 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ce11429d-76ae-4e82-be1c-b70ae173abf0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:29.921204 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ce11429d-76ae-4e82-be1c-b70ae173abf0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:29.928153 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce11429d-76ae-4e82-be1c-b70ae173abf0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:29.928606 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce11429d-76ae-4e82-be1c-b70ae173abf0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:29.929557 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce11429d-76ae-4e82-be1c-b70ae173abf0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:29.929893 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce11429d-76ae-4e82-be1c-b70ae173abf0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:30.853811 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-28287f86-1f8c-4156-85ad-a84c8fc4508c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 2.090088 Nov 12 02:28:30.857836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 218/405] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:28 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:28:30.860214 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-31f93d3c-d6de-4260-a219-e3cb7e52ecc2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:30.860901 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-31f93d3c-d6de-4260-a219-e3cb7e52ecc2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:30.868357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-31f93d3c-d6de-4260-a219-e3cb7e52ecc2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:30.868806 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-31f93d3c-d6de-4260-a219-e3cb7e52ecc2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:30.868933 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ce11429d-76ae-4e82-be1c-b70ae173abf0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.951913 Nov 12 02:28:30.869695 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 188/406] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:29 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:28:30.869833 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-31f93d3c-d6de-4260-a219-e3cb7e52ecc2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:30.869999 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-31f93d3c-d6de-4260-a219-e3cb7e52ecc2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:31.010768 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-31f93d3c-d6de-4260-a219-e3cb7e52ecc2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:31.018409 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-31f93d3c-d6de-4260-a219-e3cb7e52ecc2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.162736 Nov 12 02:28:31.019024 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 219/407] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:30 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:31.865822 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4daeb4c2-06bc-461b-895a-eaf50af6df90 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:31.867003 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4daeb4c2-06bc-461b-895a-eaf50af6df90 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:31.874386 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4daeb4c2-06bc-461b-895a-eaf50af6df90 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:31.874880 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4daeb4c2-06bc-461b-895a-eaf50af6df90 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:31.875754 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4daeb4c2-06bc-461b-895a-eaf50af6df90 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:31.876194 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4daeb4c2-06bc-461b-895a-eaf50af6df90 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:31.881525 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fce03f66-271b-4ebd-ac94-cf78e372bb88 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:31.882436 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-fce03f66-271b-4ebd-ac94-cf78e372bb88 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:31.890101 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fce03f66-271b-4ebd-ac94-cf78e372bb88 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:31.890550 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fce03f66-271b-4ebd-ac94-cf78e372bb88 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:31.891354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fce03f66-271b-4ebd-ac94-cf78e372bb88 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:31.891780 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fce03f66-271b-4ebd-ac94-cf78e372bb88 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:32.084596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4daeb4c2-06bc-461b-895a-eaf50af6df90 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.222495 Nov 12 02:28:32.085538 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 189/408] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:31 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:32.092984 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-15b48141-f73b-4b68-a060-98544f2cb95f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:32.093862 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-15b48141-f73b-4b68-a060-98544f2cb95f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:32.100819 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-15b48141-f73b-4b68-a060-98544f2cb95f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:32.101272 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-15b48141-f73b-4b68-a060-98544f2cb95f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:32.101611 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-fce03f66-271b-4ebd-ac94-cf78e372bb88 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.223722 Nov 12 02:28:32.102061 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-15b48141-f73b-4b68-a060-98544f2cb95f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:32.102542 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-15b48141-f73b-4b68-a060-98544f2cb95f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:32.103925 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 220/409] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:31 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:32.205229 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-784256461", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "networks": [{"uuid": "4070c229-4da3-4ab6-91a8-6b9e74d5d318"}]}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:32.255517 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-15b48141-f73b-4b68-a060-98544f2cb95f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:32.263415 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-15b48141-f73b-4b68-a060-98544f2cb95f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.176525 Nov 12 02:28:32.263993 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 190/410] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:32 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:32.268005 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.network.neutron [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] validate_networks() for [('4070c229-4da3-4ab6-91a8-6b9e74d5d318', None, None, None, None, None)] {{(pid=116099) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:28:32.269093 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-552705bd-838f-47bc-9274-1aa3b939a78f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:32.269744 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-552705bd-838f-47bc-9274-1aa3b939a78f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:32.277010 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-552705bd-838f-47bc-9274-1aa3b939a78f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:32.277791 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-552705bd-838f-47bc-9274-1aa3b939a78f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:32.278742 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-552705bd-838f-47bc-9274-1aa3b939a78f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:32.279319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-552705bd-838f-47bc-9274-1aa3b939a78f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:32.295879 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-552705bd-838f-47bc-9274-1aa3b939a78f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] HTTP exception thrown: Instance 8244b795-8dd2-43ee-a703-79b742cd5432 could not be found. Nov 12 02:28:32.296814 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-552705bd-838f-47bc-9274-1aa3b939a78f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Returning 404 to user: Instance 8244b795-8dd2-43ee-a703-79b742cd5432 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:28:32.303831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-552705bd-838f-47bc-9274-1aa3b939a78f tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 404 len: 111 microversion: 2.1 time: 0.038533 Nov 12 02:28:32.304884 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 191/411] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:28:32 2021] DELETE /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:28:32.314766 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6565f40d-0f27-4ecc-b48d-8443b24d9dde tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:32.315627 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6565f40d-0f27-4ecc-b48d-8443b24d9dde tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] [instance: 8244b795-8dd2-43ee-a703-79b742cd5432] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:32.322729 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6565f40d-0f27-4ecc-b48d-8443b24d9dde tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:32.323184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6565f40d-0f27-4ecc-b48d-8443b24d9dde tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:32.323961 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6565f40d-0f27-4ecc-b48d-8443b24d9dde tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:32.324558 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6565f40d-0f27-4ecc-b48d-8443b24d9dde tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:32.346600 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-6565f40d-0f27-4ecc-b48d-8443b24d9dde tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] HTTP exception thrown: Instance 8244b795-8dd2-43ee-a703-79b742cd5432 could not be found. Nov 12 02:28:32.347556 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6565f40d-0f27-4ecc-b48d-8443b24d9dde tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] Returning 404 to user: Instance 8244b795-8dd2-43ee-a703-79b742cd5432 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:28:32.348558 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6565f40d-0f27-4ecc-b48d-8443b24d9dde tempest-DeleteServersTestJSON-1750090327 tempest-DeleteServersTestJSON-1750090327-project] 10.222.0.70 "GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432" status: 404 len: 111 microversion: 2.1 time: 0.039397 Nov 12 02:28:32.353191 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 192/412] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:32 2021] GET /compute/v2.1/servers/8244b795-8dd2-43ee-a703-79b742cd5432 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:28:32.785223 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Flavor limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:28:32.785651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Image limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:28:32.786125 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Flavor pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:28:32.787116 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Image pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:28:32.787653 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:28:32.796186 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:32.796634 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:32.797478 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:32.797913 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:32.815144 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Getting quotas for project bf1009072a7446b8a468d02d87b9420d. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:28:32.819114 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Getting quotas for user 8f90ce43dddc437fbd6d0531529c6456 and project bf1009072a7446b8a468d02d87b9420d. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:28:32.829663 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Going to run 1 instances... {{(pid=116099) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:28:32.832118 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:28:32.880630 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-319a6111-d4a9-46f0-91ac-c4df5afab822 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679653 Nov 12 02:28:32.881510 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 221/413] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:28:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 12 02:28:32.891596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d73ed617-a71a-4421-b0f1-54fd37c7470b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:32.892358 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d73ed617-a71a-4421-b0f1-54fd37c7470b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:33.059666 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d73ed617-a71a-4421-b0f1-54fd37c7470b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:33.068239 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d73ed617-a71a-4421-b0f1-54fd37c7470b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1217 microversion: 2.1 time: 0.179935 Nov 12 02:28:33.069006 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 193/414] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:32 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:33.098226 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-da33aefe-fdff-402e-a52b-2fa535b69910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:33.099789 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-da33aefe-fdff-402e-a52b-2fa535b69910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:33.107799 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-da33aefe-fdff-402e-a52b-2fa535b69910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:33.108453 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-da33aefe-fdff-402e-a52b-2fa535b69910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:33.109432 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-da33aefe-fdff-402e-a52b-2fa535b69910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:33.110055 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-da33aefe-fdff-402e-a52b-2fa535b69910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:33.115586 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3c35def5-5df5-4888-8ad7-b6fd0ea8eff6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:33.116441 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3c35def5-5df5-4888-8ad7-b6fd0ea8eff6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:33.123877 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3c35def5-5df5-4888-8ad7-b6fd0ea8eff6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:33.124331 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3c35def5-5df5-4888-8ad7-b6fd0ea8eff6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:33.125122 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3c35def5-5df5-4888-8ad7-b6fd0ea8eff6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:33.125743 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3c35def5-5df5-4888-8ad7-b6fd0ea8eff6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:33.328079 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-da33aefe-fdff-402e-a52b-2fa535b69910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.234101 Nov 12 02:28:33.330142 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 222/415] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:33 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:28:33.334700 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1b1cda60-8516-42b4-82f9-7ad2e643846a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:33.335380 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1b1cda60-8516-42b4-82f9-7ad2e643846a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:33.342303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1b1cda60-8516-42b4-82f9-7ad2e643846a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:33.342879 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1b1cda60-8516-42b4-82f9-7ad2e643846a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:33.343809 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1b1cda60-8516-42b4-82f9-7ad2e643846a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:33.344297 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1b1cda60-8516-42b4-82f9-7ad2e643846a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:33.352184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3c35def5-5df5-4888-8ad7-b6fd0ea8eff6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.240487 Nov 12 02:28:33.352954 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 194/416] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:33 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:28:33.506150 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1b1cda60-8516-42b4-82f9-7ad2e643846a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:33.515091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1b1cda60-8516-42b4-82f9-7ad2e643846a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.184510 Nov 12 02:28:33.515725 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 223/417] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:33 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:34.086271 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2fc5f823-ebeb-44ad-91db-e6a6b28cebf3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:34.087008 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2fc5f823-ebeb-44ad-91db-e6a6b28cebf3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:34.103450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2fc5f823-ebeb-44ad-91db-e6a6b28cebf3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:34.103874 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2fc5f823-ebeb-44ad-91db-e6a6b28cebf3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:34.104725 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2fc5f823-ebeb-44ad-91db-e6a6b28cebf3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:34.105167 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2fc5f823-ebeb-44ad-91db-e6a6b28cebf3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:34.171008 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2fc5f823-ebeb-44ad-91db-e6a6b28cebf3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:34.178823 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2fc5f823-ebeb-44ad-91db-e6a6b28cebf3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1269 microversion: 2.1 time: 0.097083 Nov 12 02:28:34.188731 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 195/418] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:34 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1269 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:34.341161 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9d5f4b5d-0f9b-496e-a605-23786263bfaf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:34.342340 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9d5f4b5d-0f9b-496e-a605-23786263bfaf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:34.348732 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9d5f4b5d-0f9b-496e-a605-23786263bfaf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:34.349182 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9d5f4b5d-0f9b-496e-a605-23786263bfaf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:34.350431 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9d5f4b5d-0f9b-496e-a605-23786263bfaf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:34.350902 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9d5f4b5d-0f9b-496e-a605-23786263bfaf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:34.364322 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-28808a2d-b2f3-41de-95be-66cdd5b03a94 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:34.365992 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-28808a2d-b2f3-41de-95be-66cdd5b03a94 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:34.375207 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28808a2d-b2f3-41de-95be-66cdd5b03a94 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:34.375746 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28808a2d-b2f3-41de-95be-66cdd5b03a94 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:34.376696 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28808a2d-b2f3-41de-95be-66cdd5b03a94 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:34.377203 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28808a2d-b2f3-41de-95be-66cdd5b03a94 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:34.845814 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9d5f4b5d-0f9b-496e-a605-23786263bfaf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.508231 Nov 12 02:28:34.847567 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 224/419] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:34 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:34.864126 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-28808a2d-b2f3-41de-95be-66cdd5b03a94 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.503538 Nov 12 02:28:34.868969 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 196/420] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:34 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:34.873117 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-679022ef-0482-46ce-bc96-6a63eaa3dc90 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:34.873996 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-679022ef-0482-46ce-bc96-6a63eaa3dc90 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:34.889364 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-679022ef-0482-46ce-bc96-6a63eaa3dc90 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:34.889823 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-679022ef-0482-46ce-bc96-6a63eaa3dc90 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:34.890617 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-679022ef-0482-46ce-bc96-6a63eaa3dc90 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:34.891746 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-679022ef-0482-46ce-bc96-6a63eaa3dc90 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:35.011713 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b124c591-1e34-489e-b22d-94867e079a36 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] Action: 'create', calling method: .version_select at 0x7fc0647a81f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2044700353", "metadata": {"Type": "work"}}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:35.070051 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-679022ef-0482-46ce-bc96-6a63eaa3dc90 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:35.078545 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-679022ef-0482-46ce-bc96-6a63eaa3dc90 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.211381 Nov 12 02:28:35.088837 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 197/421] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:34 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:35.196008 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a0e83642-46f0-420f-8dd5-4a4476f522b8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:35.196825 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a0e83642-46f0-420f-8dd5-4a4476f522b8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:35.203389 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a0e83642-46f0-420f-8dd5-4a4476f522b8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:35.204675 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a0e83642-46f0-420f-8dd5-4a4476f522b8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:35.205547 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a0e83642-46f0-420f-8dd5-4a4476f522b8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:35.206212 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a0e83642-46f0-420f-8dd5-4a4476f522b8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:35.273955 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a0e83642-46f0-420f-8dd5-4a4476f522b8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:35.295562 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a0e83642-46f0-420f-8dd5-4a4476f522b8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1275 microversion: 2.1 time: 0.103133 Nov 12 02:28:35.296160 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 198/422] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:35 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1275 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:35.350557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b124c591-1e34-489e-b22d-94867e079a36 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.501521 Nov 12 02:28:35.357738 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 225/423] 10.222.0.70 () {60 vars in 1155 bytes} [Fri Nov 12 02:28:34 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 509 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 12 02:28:35.362823 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1d857865-8390-4f63-9538-b87ab3625094 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] Calling method '.version_select at 0x7fc064836700>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:35.411655 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1d857865-8390-4f63-9538-b87ab3625094 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/cd081b69-e208-4f45-bf14-6dd0348ccc04" status: 200 len: 353 microversion: 2.1 time: 0.052603 Nov 12 02:28:35.412738 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 199/424] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:28:35 2021] GET /compute/v2.1/os-volumes/cd081b69-e208-4f45-bf14-6dd0348ccc04 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:28:35.858658 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0c0e020e-d7e1-46e9-bb0d-af948d5ce777 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:35.860332 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0c0e020e-d7e1-46e9-bb0d-af948d5ce777 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:35.868860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0c0e020e-d7e1-46e9-bb0d-af948d5ce777 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:35.869413 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0c0e020e-d7e1-46e9-bb0d-af948d5ce777 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:35.870268 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0c0e020e-d7e1-46e9-bb0d-af948d5ce777 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:35.870911 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0c0e020e-d7e1-46e9-bb0d-af948d5ce777 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:35.877838 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-33ea10a9-06cc-43e0-9bbc-56ee9f1e6c0e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:35.878953 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-33ea10a9-06cc-43e0-9bbc-56ee9f1e6c0e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:35.887522 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-33ea10a9-06cc-43e0-9bbc-56ee9f1e6c0e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:35.888200 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-33ea10a9-06cc-43e0-9bbc-56ee9f1e6c0e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:35.889390 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-33ea10a9-06cc-43e0-9bbc-56ee9f1e6c0e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:35.890935 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-33ea10a9-06cc-43e0-9bbc-56ee9f1e6c0e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:36.098639 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-33ea10a9-06cc-43e0-9bbc-56ee9f1e6c0e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.224967 Nov 12 02:28:36.100741 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 200/425] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:35 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:36.108492 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2fdeca42-53b9-414e-b47f-167c32f75fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:36.109463 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2fdeca42-53b9-414e-b47f-167c32f75fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:36.119548 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2fdeca42-53b9-414e-b47f-167c32f75fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:36.120056 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2fdeca42-53b9-414e-b47f-167c32f75fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:36.121162 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2fdeca42-53b9-414e-b47f-167c32f75fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:36.121800 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2fdeca42-53b9-414e-b47f-167c32f75fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:36.131475 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0c0e020e-d7e1-46e9-bb0d-af948d5ce777 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.276884 Nov 12 02:28:36.132124 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 226/426] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:35 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:36.173996 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-1d83c48b-4248-408b-a994-59a863536037 req-5a1a2f53-a374-416e-8f69-6d07afffb515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b45339-7f70-45c4-9536-96f42bd1c35e", "tag": "ebd9ab39-34d5-41c8-9ee0-e6b204c9194f"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:36.175511 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:28:36.175511 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:28:36.186624 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-1d83c48b-4248-408b-a994-59a863536037 req-5a1a2f53-a374-416e-8f69-6d07afffb515 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:36.187235 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-1d83c48b-4248-408b-a994-59a863536037 req-5a1a2f53-a374-416e-8f69-6d07afffb515 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:36.217428 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-1d83c48b-4248-408b-a994-59a863536037 req-5a1a2f53-a374-416e-8f69-6d07afffb515 service nova] Creating event network-changed:ebd9ab39-34d5-41c8-9ee0-e6b204c9194f for instance b1b45339-7f70-45c4-9536-96f42bd1c35e on hv-cinder-80857 Nov 12 02:28:36.224193 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-1d83c48b-4248-408b-a994-59a863536037 req-5a1a2f53-a374-416e-8f69-6d07afffb515 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053275 Nov 12 02:28:36.225308 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 227/427] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:28:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:28:36.291253 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2fdeca42-53b9-414e-b47f-167c32f75fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:36.299932 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2fdeca42-53b9-414e-b47f-167c32f75fd9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1519 microversion: 2.1 time: 0.197349 Nov 12 02:28:36.300799 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 201/428] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:36 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:36.319006 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1a79f404-12ac-4e0c-a06b-d0db774cf0e1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:36.320096 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1a79f404-12ac-4e0c-a06b-d0db774cf0e1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:36.333620 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a79f404-12ac-4e0c-a06b-d0db774cf0e1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:36.334256 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a79f404-12ac-4e0c-a06b-d0db774cf0e1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:36.335195 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a79f404-12ac-4e0c-a06b-d0db774cf0e1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:36.335795 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a79f404-12ac-4e0c-a06b-d0db774cf0e1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:36.424183 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f611da3f-551b-411d-bee1-7f0502824b49 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] Calling method '.version_select at 0x7fc0648658b0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:36.480315 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f611da3f-551b-411d-bee1-7f0502824b49 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/cd081b69-e208-4f45-bf14-6dd0348ccc04" status: 200 len: 354 microversion: 2.1 time: 0.059643 Nov 12 02:28:36.481495 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 202/429] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:28:36 2021] GET /compute/v2.1/os-volumes/cd081b69-e208-4f45-bf14-6dd0348ccc04 => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:28:36.493220 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-89a1303f-d0f6-42db-be9c-05828e4dd062 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] Calling method '.version_select at 0x7fc064a03940>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:36.494924 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1a79f404-12ac-4e0c-a06b-d0db774cf0e1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:36.502285 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1a79f404-12ac-4e0c-a06b-d0db774cf0e1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1317 microversion: 2.1 time: 0.189516 Nov 12 02:28:36.502879 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 228/430] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:36 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:36.545142 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-89a1303f-d0f6-42db-be9c-05828e4dd062 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/cd081b69-e208-4f45-bf14-6dd0348ccc04" status: 200 len: 354 microversion: 2.1 time: 0.056626 Nov 12 02:28:36.545754 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 203/431] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:28:36 2021] GET /compute/v2.1/os-volumes/cd081b69-e208-4f45-bf14-6dd0348ccc04 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:28:36.557973 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9c02d945-0794-4929-83e0-8e4bc99cbedb tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] Calling method '.version_select at 0x7fc06487d0d0>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:36.634708 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9c02d945-0794-4929-83e0-8e4bc99cbedb tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/cd081b69-e208-4f45-bf14-6dd0348ccc04" status: 202 len: 0 microversion: 2.1 time: 0.080279 Nov 12 02:28:36.636139 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 229/432] 10.222.0.70 () {58 vars in 1247 bytes} [Fri Nov 12 02:28:36 2021] DELETE /compute/v2.1/os-volumes/cd081b69-e208-4f45-bf14-6dd0348ccc04 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:36.643392 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5fcef6e8-dda6-4190-bab3-45c6bf72add4 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] Calling method '.version_select at 0x7fc0648165e0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:36.694197 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5fcef6e8-dda6-4190-bab3-45c6bf72add4 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/cd081b69-e208-4f45-bf14-6dd0348ccc04" status: 200 len: 353 microversion: 2.1 time: 0.054288 Nov 12 02:28:36.695087 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 204/433] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:28:36 2021] GET /compute/v2.1/os-volumes/cd081b69-e208-4f45-bf14-6dd0348ccc04 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:28:37.111518 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0445d907-5d51-4a5a-b913-7039fac60f60 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:37.112430 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0445d907-5d51-4a5a-b913-7039fac60f60 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:37.119362 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0445d907-5d51-4a5a-b913-7039fac60f60 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:37.119818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0445d907-5d51-4a5a-b913-7039fac60f60 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:37.120801 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0445d907-5d51-4a5a-b913-7039fac60f60 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:37.121383 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0445d907-5d51-4a5a-b913-7039fac60f60 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:37.142491 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d7f6aa39-e93c-4a47-af48-43dad2bf2595 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:37.143450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d7f6aa39-e93c-4a47-af48-43dad2bf2595 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:37.154812 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7f6aa39-e93c-4a47-af48-43dad2bf2595 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:37.155519 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7f6aa39-e93c-4a47-af48-43dad2bf2595 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:37.156452 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7f6aa39-e93c-4a47-af48-43dad2bf2595 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:37.157665 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7f6aa39-e93c-4a47-af48-43dad2bf2595 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:37.419670 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d7f6aa39-e93c-4a47-af48-43dad2bf2595 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.280592 Nov 12 02:28:37.422817 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 205/434] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:37 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:37.426547 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-90c8c573-773a-4eac-a829-962970a42805 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:37.427330 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-90c8c573-773a-4eac-a829-962970a42805 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:37.435846 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90c8c573-773a-4eac-a829-962970a42805 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:37.436505 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90c8c573-773a-4eac-a829-962970a42805 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:37.437495 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90c8c573-773a-4eac-a829-962970a42805 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:37.438089 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-90c8c573-773a-4eac-a829-962970a42805 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:37.441679 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0445d907-5d51-4a5a-b913-7039fac60f60 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.334112 Nov 12 02:28:37.445651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 230/435] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:37 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:37.450782 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-988408825", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1761431138", "security_groups": [{"name": "tempest-secgroup-smoke-677549840"}], "block_device_mapping_v2": [{"uuid": "8f15182e-2c61-4ecc-8a5f-f111473e5938", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "987f135b-2ece-4383-9fb9-ce7b7e8f8bd1"}]}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:37.618496 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.network.neutron [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] validate_networks() for [('987f135b-2ece-4383-9fb9-ce7b7e8f8bd1', None, None, None, None, None)] {{(pid=116099) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:28:37.627243 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-90c8c573-773a-4eac-a829-962970a42805 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:37.635407 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-90c8c573-773a-4eac-a829-962970a42805 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1499 microversion: 2.1 time: 0.213181 Nov 12 02:28:37.635980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 206/436] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:37 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1499 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:37.646494 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-aeb04a0c-f890-4e00-9adf-dd87530a89ba tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:37.647497 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-aeb04a0c-f890-4e00-9adf-dd87530a89ba tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:37.654886 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aeb04a0c-f890-4e00-9adf-dd87530a89ba tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:37.655695 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aeb04a0c-f890-4e00-9adf-dd87530a89ba tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:37.657287 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aeb04a0c-f890-4e00-9adf-dd87530a89ba tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:37.657953 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aeb04a0c-f890-4e00-9adf-dd87530a89ba tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:37.870920 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-aeb04a0c-f890-4e00-9adf-dd87530a89ba tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:37.877917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-aeb04a0c-f890-4e00-9adf-dd87530a89ba tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1317 microversion: 2.1 time: 0.240718 Nov 12 02:28:37.878721 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 207/437] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:37 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:37.884325 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b73fe901-deae-4b4f-9051-8a92bd36f785 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:37.885111 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b73fe901-deae-4b4f-9051-8a92bd36f785 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:37.891333 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b73fe901-deae-4b4f-9051-8a92bd36f785 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:37.891864 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b73fe901-deae-4b4f-9051-8a92bd36f785 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:37.892718 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b73fe901-deae-4b4f-9051-8a92bd36f785 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:37.893225 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b73fe901-deae-4b4f-9051-8a92bd36f785 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:38.138710 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b73fe901-deae-4b4f-9051-8a92bd36f785 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:38.149982 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b73fe901-deae-4b4f-9051-8a92bd36f785 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1513 microversion: 2.1 time: 0.269922 Nov 12 02:28:38.151645 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 208/438] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:37 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1513 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:38.156529 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-51064678-beb0-4e48-ad9d-90b2e8eb4bd2 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] Calling method '.version_select at 0x7fc065337430>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:38.169508 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Flavor limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:28:38.170122 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Image limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:28:38.170825 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Flavor pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:28:38.171328 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Image pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:28:38.172653 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:28:38.183652 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:38.184233 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:38.185145 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:38.185678 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:38.207553 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Getting quotas for project cdddbe78d48c4a9995c9d3e6c06bec3d. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:28:38.212469 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-51064678-beb0-4e48-ad9d-90b2e8eb4bd2 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] HTTP exception thrown: Volume cd081b69-e208-4f45-bf14-6dd0348ccc04 could not be found. Nov 12 02:28:38.212983 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Getting quotas for user e5cae9ebcf844041b45c03bfd1fddcf6 and project cdddbe78d48c4a9995c9d3e6c06bec3d. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:28:38.213335 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-51064678-beb0-4e48-ad9d-90b2e8eb4bd2 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] Returning 404 to user: Volume cd081b69-e208-4f45-bf14-6dd0348ccc04 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:28:38.214208 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-51064678-beb0-4e48-ad9d-90b2e8eb4bd2 tempest-VolumesGetTestJSON-327858377 tempest-VolumesGetTestJSON-327858377-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/cd081b69-e208-4f45-bf14-6dd0348ccc04" status: 404 len: 109 microversion: 2.1 time: 0.061175 Nov 12 02:28:38.214776 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 209/439] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:28:38 2021] GET /compute/v2.1/os-volumes/cd081b69-e208-4f45-bf14-6dd0348ccc04 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:28:38.311442 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Going to run 1 instances... {{(pid=116099) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:28:38.313856 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f15182e-2c61-4ecc-8a5f-f111473e5938',volume_size=None,volume_type=None)] {{(pid=116099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:28:38.431099 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-97b590d9-fbad-4277-86fc-b6e923794084 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:38.432078 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-97b590d9-fbad-4277-86fc-b6e923794084 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:38.439171 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-97b590d9-fbad-4277-86fc-b6e923794084 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:38.439625 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-97b590d9-fbad-4277-86fc-b6e923794084 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:38.440469 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-97b590d9-fbad-4277-86fc-b6e923794084 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:38.440906 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-97b590d9-fbad-4277-86fc-b6e923794084 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:38.482886 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3f349c90-f5da-429e-b6e6-4a19ece5525b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.034200 Nov 12 02:28:38.488532 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 231/440] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:28:37 2021] POST /compute/v2.1/servers => generated 405 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:28:38.489375 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-478dd556-a96a-48d6-a029-230df5cbfb2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:38.490635 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-478dd556-a96a-48d6-a029-230df5cbfb2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:38.503773 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-478dd556-a96a-48d6-a029-230df5cbfb2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:38.504223 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-478dd556-a96a-48d6-a029-230df5cbfb2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:38.505561 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-478dd556-a96a-48d6-a029-230df5cbfb2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:38.505998 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-478dd556-a96a-48d6-a029-230df5cbfb2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:38.635377 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-97b590d9-fbad-4277-86fc-b6e923794084 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.208041 Nov 12 02:28:38.639492 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 210/441] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:38 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:28:38.641161 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-34ade429-0f9c-4c08-88fd-3bb2d5dc675f tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:38.642076 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-34ade429-0f9c-4c08-88fd-3bb2d5dc675f tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:38.652085 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-478dd556-a96a-48d6-a029-230df5cbfb2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.166063 Nov 12 02:28:38.653627 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 232/442] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:38 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:38.713489 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-34ade429-0f9c-4c08-88fd-3bb2d5dc675f tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:38.723068 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-34ade429-0f9c-4c08-88fd-3bb2d5dc675f tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1094 microversion: 2.1 time: 0.085124 Nov 12 02:28:38.723631 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 211/443] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:38 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:38.905943 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7f36f425-0249-4dce-b672-99e577e6823b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:38.906637 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7f36f425-0249-4dce-b672-99e577e6823b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:38.916518 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7f36f425-0249-4dce-b672-99e577e6823b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:38.917066 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7f36f425-0249-4dce-b672-99e577e6823b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:38.917857 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7f36f425-0249-4dce-b672-99e577e6823b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:38.918288 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7f36f425-0249-4dce-b672-99e577e6823b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:39.088860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7f36f425-0249-4dce-b672-99e577e6823b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:39.097064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7f36f425-0249-4dce-b672-99e577e6823b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1317 microversion: 2.1 time: 0.196199 Nov 12 02:28:39.097868 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 233/444] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:38 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:39.648229 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-55df0ce2-18ea-4cca-ad67-c8bd92b34d8e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:39.649254 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-55df0ce2-18ea-4cca-ad67-c8bd92b34d8e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:39.656716 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-55df0ce2-18ea-4cca-ad67-c8bd92b34d8e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:39.657175 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-55df0ce2-18ea-4cca-ad67-c8bd92b34d8e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:39.658029 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-55df0ce2-18ea-4cca-ad67-c8bd92b34d8e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:39.658726 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-55df0ce2-18ea-4cca-ad67-c8bd92b34d8e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:39.665151 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-86175677-bd31-4725-8f92-356732967e00 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:39.666297 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-86175677-bd31-4725-8f92-356732967e00 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:39.674728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-86175677-bd31-4725-8f92-356732967e00 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:39.675176 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-86175677-bd31-4725-8f92-356732967e00 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:39.694688 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-86175677-bd31-4725-8f92-356732967e00 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:39.695538 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-86175677-bd31-4725-8f92-356732967e00 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:39.851893 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-86175677-bd31-4725-8f92-356732967e00 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.191027 Nov 12 02:28:39.853441 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 234/445] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:39 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:28:39.859889 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2bc5e64a-5ee4-4771-a3d0-f16c9daf285a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:39.860358 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2bc5e64a-5ee4-4771-a3d0-f16c9daf285a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:39.871112 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-55df0ce2-18ea-4cca-ad67-c8bd92b34d8e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.227551 Nov 12 02:28:39.871742 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 212/446] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:39 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:39.873973 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2bc5e64a-5ee4-4771-a3d0-f16c9daf285a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:39.875088 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2bc5e64a-5ee4-4771-a3d0-f16c9daf285a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:39.876788 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2bc5e64a-5ee4-4771-a3d0-f16c9daf285a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:39.877434 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2bc5e64a-5ee4-4771-a3d0-f16c9daf285a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:40.085605 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-2bc5e64a-5ee4-4771-a3d0-f16c9daf285a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:40.093183 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2bc5e64a-5ee4-4771-a3d0-f16c9daf285a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1210 microversion: 2.1 time: 0.238925 Nov 12 02:28:40.093755 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 235/447] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:39 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1210 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:40.114972 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e69479c1-0748-401c-a62e-c89470cc3bb9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:40.115945 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e69479c1-0748-401c-a62e-c89470cc3bb9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:40.123933 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e69479c1-0748-401c-a62e-c89470cc3bb9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:40.124509 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e69479c1-0748-401c-a62e-c89470cc3bb9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:40.133654 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e69479c1-0748-401c-a62e-c89470cc3bb9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:40.134222 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e69479c1-0748-401c-a62e-c89470cc3bb9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:40.308581 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e69479c1-0748-401c-a62e-c89470cc3bb9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:40.316063 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e69479c1-0748-401c-a62e-c89470cc3bb9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1317 microversion: 2.1 time: 0.205097 Nov 12 02:28:40.316625 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 213/448] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:40 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:40.637274 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-29d40337-0c10-4789-8dde-4595e4d34bc6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:40.638242 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-29d40337-0c10-4789-8dde-4595e4d34bc6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:40.644881 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-29d40337-0c10-4789-8dde-4595e4d34bc6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:40.645334 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-29d40337-0c10-4789-8dde-4595e4d34bc6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:40.646362 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-29d40337-0c10-4789-8dde-4595e4d34bc6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:40.646989 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-29d40337-0c10-4789-8dde-4595e4d34bc6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:40.673242 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-29d40337-0c10-4789-8dde-4595e4d34bc6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lazy-loading 'flavor' on Instance uuid 44c025f0-3bb5-4ce5-944f-0f553ef80f8a {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:28:40.817194 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-29d40337-0c10-4789-8dde-4595e4d34bc6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "POST /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/action" status: 200 len: 32 microversion: 2.1 time: 0.183975 Nov 12 02:28:40.817809 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 236/449] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:40 2021] POST /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:28:40.826680 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9b4fe717-7f97-4df2-a7d2-3d3d15f54ca2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:40.827322 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9b4fe717-7f97-4df2-a7d2-3d3d15f54ca2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:40.836752 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9b4fe717-7f97-4df2-a7d2-3d3d15f54ca2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:40.837097 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9b4fe717-7f97-4df2-a7d2-3d3d15f54ca2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:40.837861 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9b4fe717-7f97-4df2-a7d2-3d3d15f54ca2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:40.838312 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9b4fe717-7f97-4df2-a7d2-3d3d15f54ca2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:40.865348 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3a6eeb89-e8d3-4211-a3a7-229f7ba484dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:40.867032 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3a6eeb89-e8d3-4211-a3a7-229f7ba484dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:40.873532 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3a6eeb89-e8d3-4211-a3a7-229f7ba484dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:40.874385 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3a6eeb89-e8d3-4211-a3a7-229f7ba484dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:40.875372 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3a6eeb89-e8d3-4211-a3a7-229f7ba484dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:40.876094 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3a6eeb89-e8d3-4211-a3a7-229f7ba484dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:41.086896 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3a6eeb89-e8d3-4211-a3a7-229f7ba484dd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.225278 Nov 12 02:28:41.088632 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 237/450] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:40 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:41.100205 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-59fa4829-9a0e-4b31-b781-17e3feaa8ddf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:41.103385 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-59fa4829-9a0e-4b31-b781-17e3feaa8ddf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:41.119117 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-59fa4829-9a0e-4b31-b781-17e3feaa8ddf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:41.119840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-59fa4829-9a0e-4b31-b781-17e3feaa8ddf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:41.120886 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-59fa4829-9a0e-4b31-b781-17e3feaa8ddf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:41.121555 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-59fa4829-9a0e-4b31-b781-17e3feaa8ddf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:41.173231 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9b4fe717-7f97-4df2-a7d2-3d3d15f54ca2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:41.183750 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9b4fe717-7f97-4df2-a7d2-3d3d15f54ca2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.360312 Nov 12 02:28:41.185776 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 214/451] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:40 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:41.201625 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1c5e3e37-b281-482e-abf7-cd5dbfd9cd12 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:41.204224 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1c5e3e37-b281-482e-abf7-cd5dbfd9cd12 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:41.212831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c5e3e37-b281-482e-abf7-cd5dbfd9cd12 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:41.213828 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c5e3e37-b281-482e-abf7-cd5dbfd9cd12 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:41.219475 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c5e3e37-b281-482e-abf7-cd5dbfd9cd12 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:41.220008 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c5e3e37-b281-482e-abf7-cd5dbfd9cd12 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:41.263871 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-59fa4829-9a0e-4b31-b781-17e3feaa8ddf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.172273 Nov 12 02:28:41.264945 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 238/452] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:41 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:41.299912 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-65ea590d-3661-4539-9e6d-565d5c541cf8 req-9def9763-8bd0-47ba-88d3-e78b7c9a4067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f436b1-6651-4ba7-88f7-fb2b262f75a5", "tag": "1d8b5f9f-4b28-410e-8111-4c6483f94044"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:41.302869 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:28:41.302869 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:28:41.331586 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-65ea590d-3661-4539-9e6d-565d5c541cf8 req-9def9763-8bd0-47ba-88d3-e78b7c9a4067 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:41.332292 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-65ea590d-3661-4539-9e6d-565d5c541cf8 req-9def9763-8bd0-47ba-88d3-e78b7c9a4067 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:41.347692 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-65ea590d-3661-4539-9e6d-565d5c541cf8 req-9def9763-8bd0-47ba-88d3-e78b7c9a4067 service nova] Creating event network-changed:1d8b5f9f-4b28-410e-8111-4c6483f94044 for instance a5f436b1-6651-4ba7-88f7-fb2b262f75a5 on hv-cinder-80857 Nov 12 02:28:41.372062 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-65ea590d-3661-4539-9e6d-565d5c541cf8 req-9def9763-8bd0-47ba-88d3-e78b7c9a4067 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104142 Nov 12 02:28:41.373137 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 239/453] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:28:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:28:41.381709 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ade54ea0-37bf-4fdf-92a5-48cd108b6dfa tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:41.382853 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ade54ea0-37bf-4fdf-92a5-48cd108b6dfa tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:41.393662 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ade54ea0-37bf-4fdf-92a5-48cd108b6dfa tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:41.394419 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ade54ea0-37bf-4fdf-92a5-48cd108b6dfa tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:41.396677 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ade54ea0-37bf-4fdf-92a5-48cd108b6dfa tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:41.397327 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ade54ea0-37bf-4fdf-92a5-48cd108b6dfa tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:41.852036 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1c5e3e37-b281-482e-abf7-cd5dbfd9cd12 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:41.859526 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1c5e3e37-b281-482e-abf7-cd5dbfd9cd12 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1277 microversion: 2.1 time: 0.661467 Nov 12 02:28:41.870614 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 215/454] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:41 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1277 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:41.934180 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ade54ea0-37bf-4fdf-92a5-48cd108b6dfa tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:41.941666 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ade54ea0-37bf-4fdf-92a5-48cd108b6dfa tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1317 microversion: 2.1 time: 0.567139 Nov 12 02:28:41.942954 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 240/455] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:41 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:42.100329 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-58a436fe-dbe3-4831-a8fe-655eaf2ee4e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:42.101674 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-58a436fe-dbe3-4831-a8fe-655eaf2ee4e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:42.108033 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-58a436fe-dbe3-4831-a8fe-655eaf2ee4e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:42.108485 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-58a436fe-dbe3-4831-a8fe-655eaf2ee4e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:42.109269 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-58a436fe-dbe3-4831-a8fe-655eaf2ee4e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:42.109700 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-58a436fe-dbe3-4831-a8fe-655eaf2ee4e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:42.202761 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-31a9d2dc-1e4f-4d31-80b0-d64c3fe81a8a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:42.203520 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-31a9d2dc-1e4f-4d31-80b0-d64c3fe81a8a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:42.210732 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-31a9d2dc-1e4f-4d31-80b0-d64c3fe81a8a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:42.211185 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-31a9d2dc-1e4f-4d31-80b0-d64c3fe81a8a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:42.211973 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-31a9d2dc-1e4f-4d31-80b0-d64c3fe81a8a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:42.212407 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-31a9d2dc-1e4f-4d31-80b0-d64c3fe81a8a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:42.325835 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-58a436fe-dbe3-4831-a8fe-655eaf2ee4e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.230045 Nov 12 02:28:42.326543 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 216/456] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:42 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:28:42.332203 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d60c1538-d3df-4afc-aa55-8299c3bef26c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:42.333999 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d60c1538-d3df-4afc-aa55-8299c3bef26c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:42.348296 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d60c1538-d3df-4afc-aa55-8299c3bef26c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:42.348695 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-31a9d2dc-1e4f-4d31-80b0-d64c3fe81a8a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:42.349098 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d60c1538-d3df-4afc-aa55-8299c3bef26c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:42.349988 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d60c1538-d3df-4afc-aa55-8299c3bef26c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:42.350490 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d60c1538-d3df-4afc-aa55-8299c3bef26c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:42.357746 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-31a9d2dc-1e4f-4d31-80b0-d64c3fe81a8a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.159052 Nov 12 02:28:42.358731 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 241/457] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:42 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:42.363751 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c0e80c54-0593-4d24-8dbb-f7dc3987a81e tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] Calling method '.version_select at 0x7fc0648300d0>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:42.412787 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c0e80c54-0593-4d24-8dbb-f7dc3987a81e tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4c57f2c0-2c16-443a-86e6-ff8d4ac32e0e" status: 200 len: 350 microversion: 2.1 time: 0.052671 Nov 12 02:28:42.413356 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 242/458] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:28:42 2021] GET /compute/v2.1/os-volumes/4c57f2c0-2c16-443a-86e6-ff8d4ac32e0e => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:28:42.517633 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d60c1538-d3df-4afc-aa55-8299c3bef26c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.189250 Nov 12 02:28:42.518349 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 217/459] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:42 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:42.878184 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-77155373-493e-4ebf-9e4f-e57a88897100 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:42.878854 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-77155373-493e-4ebf-9e4f-e57a88897100 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:42.885585 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-77155373-493e-4ebf-9e4f-e57a88897100 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:42.886033 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-77155373-493e-4ebf-9e4f-e57a88897100 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:42.886846 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-77155373-493e-4ebf-9e4f-e57a88897100 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:42.887283 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-77155373-493e-4ebf-9e4f-e57a88897100 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:42.959533 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-699f59a2-fff5-4749-96fd-da5854434e94 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:42.960166 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-699f59a2-fff5-4749-96fd-da5854434e94 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:42.967761 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-699f59a2-fff5-4749-96fd-da5854434e94 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:42.974789 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-699f59a2-fff5-4749-96fd-da5854434e94 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:42.975621 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-699f59a2-fff5-4749-96fd-da5854434e94 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:42.976135 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-699f59a2-fff5-4749-96fd-da5854434e94 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:43.026772 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-77155373-493e-4ebf-9e4f-e57a88897100 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:43.034696 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-77155373-493e-4ebf-9e4f-e57a88897100 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.160928 Nov 12 02:28:43.035400 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 243/460] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:42 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:43.239846 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-699f59a2-fff5-4749-96fd-da5854434e94 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:43.248063 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-699f59a2-fff5-4749-96fd-da5854434e94 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1317 microversion: 2.1 time: 0.292692 Nov 12 02:28:43.248776 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 218/461] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:42 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:43.337219 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e97f8d98-55fa-47c6-97dd-a53be850f5ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:43.338185 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e97f8d98-55fa-47c6-97dd-a53be850f5ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:43.344124 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e97f8d98-55fa-47c6-97dd-a53be850f5ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:43.344567 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e97f8d98-55fa-47c6-97dd-a53be850f5ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:43.345336 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e97f8d98-55fa-47c6-97dd-a53be850f5ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:43.345767 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e97f8d98-55fa-47c6-97dd-a53be850f5ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:43.377365 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-74d1d8e5-081e-4768-b4ed-8cde57d0ce64 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:43.378213 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-74d1d8e5-081e-4768-b4ed-8cde57d0ce64 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:43.384840 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-74d1d8e5-081e-4768-b4ed-8cde57d0ce64 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:43.385284 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-74d1d8e5-081e-4768-b4ed-8cde57d0ce64 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:43.386181 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-74d1d8e5-081e-4768-b4ed-8cde57d0ce64 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:43.386686 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-74d1d8e5-081e-4768-b4ed-8cde57d0ce64 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:43.456633 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e97f8d98-55fa-47c6-97dd-a53be850f5ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.122854 Nov 12 02:28:43.457288 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 244/462] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:43 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:43.517991 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-74d1d8e5-081e-4768-b4ed-8cde57d0ce64 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:43.528432 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-74d1d8e5-081e-4768-b4ed-8cde57d0ce64 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.154981 Nov 12 02:28:43.529064 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 219/463] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:43 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:43.532854 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3274bcce-f65b-45a5-b9ee-508344e721a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:43.533859 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3274bcce-f65b-45a5-b9ee-508344e721a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:43.543183 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3274bcce-f65b-45a5-b9ee-508344e721a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:43.543636 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3274bcce-f65b-45a5-b9ee-508344e721a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:43.544421 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3274bcce-f65b-45a5-b9ee-508344e721a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:43.544860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3274bcce-f65b-45a5-b9ee-508344e721a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:43.719531 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6debeb3f-6d09-41ef-982f-e9ead55e1ecd tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] Calling method '.version_select at 0x7fc0647f19d0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:43.757350 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3274bcce-f65b-45a5-b9ee-508344e721a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.225798 Nov 12 02:28:43.760600 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 245/464] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:43 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:43.780571 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6debeb3f-6d09-41ef-982f-e9ead55e1ecd tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/3fe021e8-cf62-44af-8620-bdf8e3702224" status: 200 len: 351 microversion: 2.1 time: 0.064537 Nov 12 02:28:43.781125 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 220/465] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:28:43 2021] GET /compute/v2.1/os-volumes/3fe021e8-cf62-44af-8620-bdf8e3702224 => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:28:44.053488 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1997c2ab-18ca-4d68-b3cc-e766fab3c334 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:44.054411 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1997c2ab-18ca-4d68-b3cc-e766fab3c334 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:44.061785 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1997c2ab-18ca-4d68-b3cc-e766fab3c334 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:44.062376 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1997c2ab-18ca-4d68-b3cc-e766fab3c334 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:44.063293 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1997c2ab-18ca-4d68-b3cc-e766fab3c334 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:44.063920 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1997c2ab-18ca-4d68-b3cc-e766fab3c334 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:44.208551 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1997c2ab-18ca-4d68-b3cc-e766fab3c334 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:44.215904 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1997c2ab-18ca-4d68-b3cc-e766fab3c334 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.166525 Nov 12 02:28:44.216380 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 246/466] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:44 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:44.265293 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5821f4ab-f20c-4214-9759-e3c11f3d674d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:44.265903 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5821f4ab-f20c-4214-9759-e3c11f3d674d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:44.272496 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5821f4ab-f20c-4214-9759-e3c11f3d674d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:44.273012 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5821f4ab-f20c-4214-9759-e3c11f3d674d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:44.273769 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5821f4ab-f20c-4214-9759-e3c11f3d674d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:44.274206 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5821f4ab-f20c-4214-9759-e3c11f3d674d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:44.420237 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5821f4ab-f20c-4214-9759-e3c11f3d674d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:44.428367 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5821f4ab-f20c-4214-9759-e3c11f3d674d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1317 microversion: 2.1 time: 0.167102 Nov 12 02:28:44.429151 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 221/467] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:44 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:44.469821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-af70c3e4-079e-42c1-b71c-312bcea572c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:44.470792 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-af70c3e4-079e-42c1-b71c-312bcea572c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:44.478917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-af70c3e4-079e-42c1-b71c-312bcea572c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:44.479468 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-af70c3e4-079e-42c1-b71c-312bcea572c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:44.480323 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-af70c3e4-079e-42c1-b71c-312bcea572c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:44.480848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-af70c3e4-079e-42c1-b71c-312bcea572c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:44.536830 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-3294b3a0-6c1d-40cd-9b14-4272a25bd7d7 req-3503686b-b517-47e4-a163-aff2beaada48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b45339-7f70-45c4-9536-96f42bd1c35e", "name": "network-vif-plugged", "status": "completed", "tag": "ebd9ab39-34d5-41c8-9ee0-e6b204c9194f"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:44.540147 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:28:44.540147 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:28:44.546841 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-3294b3a0-6c1d-40cd-9b14-4272a25bd7d7 req-3503686b-b517-47e4-a163-aff2beaada48 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:44.547295 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-3294b3a0-6c1d-40cd-9b14-4272a25bd7d7 req-3503686b-b517-47e4-a163-aff2beaada48 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:44.559635 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-3294b3a0-6c1d-40cd-9b14-4272a25bd7d7 req-3503686b-b517-47e4-a163-aff2beaada48 service nova] Creating event network-vif-plugged:ebd9ab39-34d5-41c8-9ee0-e6b204c9194f for instance b1b45339-7f70-45c4-9536-96f42bd1c35e on hv-cinder-80857 Nov 12 02:28:44.564675 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-3294b3a0-6c1d-40cd-9b14-4272a25bd7d7 req-3503686b-b517-47e4-a163-aff2beaada48 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034169 Nov 12 02:28:44.565424 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 222/468] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:28:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:28:44.570510 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-01fe0955-d0ad-49e6-a374-bcb88bc0b78e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:44.571367 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-01fe0955-d0ad-49e6-a374-bcb88bc0b78e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:44.578031 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-01fe0955-d0ad-49e6-a374-bcb88bc0b78e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:44.578496 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-01fe0955-d0ad-49e6-a374-bcb88bc0b78e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:44.579252 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-af70c3e4-079e-42c1-b71c-312bcea572c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.113614 Nov 12 02:28:44.579406 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-01fe0955-d0ad-49e6-a374-bcb88bc0b78e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:44.579575 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 247/469] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:44 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:44.583515 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-01fe0955-d0ad-49e6-a374-bcb88bc0b78e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:44.731947 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-01fe0955-d0ad-49e6-a374-bcb88bc0b78e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:44.743079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-01fe0955-d0ad-49e6-a374-bcb88bc0b78e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.175922 Nov 12 02:28:44.744332 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 223/470] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:44 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:44.775627 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1d3e8fd1-8f3a-4499-9933-fead9e5074b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:44.776782 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1d3e8fd1-8f3a-4499-9933-fead9e5074b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:44.784135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1d3e8fd1-8f3a-4499-9933-fead9e5074b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:44.784681 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1d3e8fd1-8f3a-4499-9933-fead9e5074b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:44.785543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1d3e8fd1-8f3a-4499-9933-fead9e5074b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:44.786602 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1d3e8fd1-8f3a-4499-9933-fead9e5074b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:44.877239 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1d3e8fd1-8f3a-4499-9933-fead9e5074b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.105395 Nov 12 02:28:44.878022 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 248/471] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:44 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:45.098354 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0780250f-c17a-4991-bdaa-6a45245be5d4 tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] Calling method '.version_select at 0x7fc064930ca0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:45.147419 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0780250f-c17a-4991-bdaa-6a45245be5d4 tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/1ebe001e-5f7d-453b-aa96-847984c41470" status: 200 len: 351 microversion: 2.1 time: 0.052635 Nov 12 02:28:45.148162 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 224/472] 10.222.0.70 () {58 vars in 1244 bytes} [Fri Nov 12 02:28:45 2021] GET /compute/v2.1/os-volumes/1ebe001e-5f7d-453b-aa96-847984c41470 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:28:45.159588 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-aebc09db-3d4b-4456-aa9c-2c145b5b956b tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] Calling method '.version_select at 0x7fc064975dc0>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:45.233474 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ce4c42a7-e607-4458-bc50-4f1641261577 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:45.234323 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ce4c42a7-e607-4458-bc50-4f1641261577 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:45.239167 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-aebc09db-3d4b-4456-aa9c-2c145b5b956b tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083431 Nov 12 02:28:45.240404 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 249/473] 10.222.0.70 () {58 vars in 1133 bytes} [Fri Nov 12 02:28:45 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:45.243600 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce4c42a7-e607-4458-bc50-4f1641261577 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:45.244058 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce4c42a7-e607-4458-bc50-4f1641261577 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:45.244890 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce4c42a7-e607-4458-bc50-4f1641261577 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:45.245343 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce4c42a7-e607-4458-bc50-4f1641261577 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:45.253374 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a9c1907f-1876-45bf-bca0-2238b7c9bc94 tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] Calling method '.version_select at 0x7fc0648304c0>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:45.337163 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a9c1907f-1876-45bf-bca0-2238b7c9bc94 tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087231 Nov 12 02:28:45.337984 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 250/474] 10.222.0.70 () {58 vars in 1148 bytes} [Fri Nov 12 02:28:45 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:28:45.349554 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6ffc4763-1baf-42ca-ac8f-3b426f3104dd tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] Calling method '.version_select at 0x7fc06488a670>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:45.394629 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ce4c42a7-e607-4458-bc50-4f1641261577 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:45.404177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ce4c42a7-e607-4458-bc50-4f1641261577 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.174654 Nov 12 02:28:45.415322 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 225/475] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:45 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:45.445884 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0f6f56e8-5c64-4b4b-a157-346c4e99143b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:45.446914 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0f6f56e8-5c64-4b4b-a157-346c4e99143b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:45.453511 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f6f56e8-5c64-4b4b-a157-346c4e99143b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:45.454142 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f6f56e8-5c64-4b4b-a157-346c4e99143b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:45.455229 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f6f56e8-5c64-4b4b-a157-346c4e99143b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:45.455811 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f6f56e8-5c64-4b4b-a157-346c4e99143b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:45.464623 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6ffc4763-1baf-42ca-ac8f-3b426f3104dd tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.118991 Nov 12 02:28:45.465188 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 251/476] 10.222.0.70 () {58 vars in 1133 bytes} [Fri Nov 12 02:28:45 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:45.480048 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c0f061f3-d090-40c7-b504-c03404609c17 tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] Calling method '.version_select at 0x7fc0647a8e50>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:45.578718 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c0f061f3-d090-40c7-b504-c03404609c17 tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.102322 Nov 12 02:28:45.579660 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 252/477] 10.222.0.70 () {58 vars in 1166 bytes} [Fri Nov 12 02:28:45 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:28:45.592909 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6e2273cd-6135-4eeb-aca2-52a67b6cf73e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:45.593936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6e2273cd-6135-4eeb-aca2-52a67b6cf73e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:45.600936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6e2273cd-6135-4eeb-aca2-52a67b6cf73e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:45.601341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6e2273cd-6135-4eeb-aca2-52a67b6cf73e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:45.602300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6e2273cd-6135-4eeb-aca2-52a67b6cf73e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:45.602903 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6e2273cd-6135-4eeb-aca2-52a67b6cf73e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:45.631578 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0f6f56e8-5c64-4b4b-a157-346c4e99143b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:45.641000 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0f6f56e8-5c64-4b4b-a157-346c4e99143b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1317 microversion: 2.1 time: 0.199475 Nov 12 02:28:45.641597 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 226/478] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:45 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:45.646747 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8f8f440a-a8f3-45b3-b456-780f88b66651 tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] Calling method '.version_select at 0x7fc0652b8c10>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:45.709536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6e2273cd-6135-4eeb-aca2-52a67b6cf73e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.120323 Nov 12 02:28:45.711234 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 253/479] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:45 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:45.727178 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8f8f440a-a8f3-45b3-b456-780f88b66651 tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084270 Nov 12 02:28:45.727825 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 227/480] 10.222.0.70 () {58 vars in 1169 bytes} [Fri Nov 12 02:28:45 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:28:45.740531 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-041d2b20-e33c-422e-88f7-ca68e12de3c9 tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] Calling method '.version_select at 0x7fc06488c550>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:45.761913 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4d667312-e409-480b-9c13-8042f58e1901 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:45.767792 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4d667312-e409-480b-9c13-8042f58e1901 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:45.777957 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d667312-e409-480b-9c13-8042f58e1901 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:45.779103 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d667312-e409-480b-9c13-8042f58e1901 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:45.780305 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d667312-e409-480b-9c13-8042f58e1901 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:45.781022 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d667312-e409-480b-9c13-8042f58e1901 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:45.830276 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-041d2b20-e33c-422e-88f7-ca68e12de3c9 tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.093590 Nov 12 02:28:45.830864 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 254/481] 10.222.0.70 () {58 vars in 1154 bytes} [Fri Nov 12 02:28:45 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:45.842368 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f220f469-a587-46bc-b0e8-dbc074f92446 tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] Calling method '.version_select at 0x7fc065230a60>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:45.939330 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f220f469-a587-46bc-b0e8-dbc074f92446 tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.100806 Nov 12 02:28:45.940189 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 255/482] 10.222.0.70 () {58 vars in 1187 bytes} [Fri Nov 12 02:28:45 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:28:45.945183 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-df971127-ab59-45d2-a45c-73f5018e73d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:45.946498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-df971127-ab59-45d2-a45c-73f5018e73d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:45.952912 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4d667312-e409-480b-9c13-8042f58e1901 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:45.960192 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-df971127-ab59-45d2-a45c-73f5018e73d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:45.960950 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-df971127-ab59-45d2-a45c-73f5018e73d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:45.962169 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-df971127-ab59-45d2-a45c-73f5018e73d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:45.962749 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4d667312-e409-480b-9c13-8042f58e1901 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.205208 Nov 12 02:28:45.963085 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-df971127-ab59-45d2-a45c-73f5018e73d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:45.963744 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 228/483] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:45 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:45.968598 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9ca4a290-fbdf-47b4-9953-5bac4c8fdbfe tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] Calling method '.version_select at 0x7fc064945550>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:46.054314 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9ca4a290-fbdf-47b4-9953-5bac4c8fdbfe tempest-VolumesTestJSON-1687539773 tempest-VolumesTestJSON-1687539773-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089351 Nov 12 02:28:46.054944 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 229/484] 10.222.0.70 () {58 vars in 1154 bytes} [Fri Nov 12 02:28:45 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:46.068097 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-df971127-ab59-45d2-a45c-73f5018e73d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.125549 Nov 12 02:28:46.069281 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 256/485] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:45 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:46.422030 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b951776c-728a-4850-969f-100f04132339 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:46.422649 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b951776c-728a-4850-969f-100f04132339 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:46.429809 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b951776c-728a-4850-969f-100f04132339 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:46.430260 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b951776c-728a-4850-969f-100f04132339 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:46.431076 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b951776c-728a-4850-969f-100f04132339 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:46.431513 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b951776c-728a-4850-969f-100f04132339 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:46.575974 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b951776c-728a-4850-969f-100f04132339 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:46.585979 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b951776c-728a-4850-969f-100f04132339 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.168101 Nov 12 02:28:46.586556 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 230/486] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:46 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:46.658545 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2ac0b86a-431d-4d89-9959-efac529c1d65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:46.659264 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2ac0b86a-431d-4d89-9959-efac529c1d65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:46.667175 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2ac0b86a-431d-4d89-9959-efac529c1d65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:46.667628 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2ac0b86a-431d-4d89-9959-efac529c1d65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:46.668460 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2ac0b86a-431d-4d89-9959-efac529c1d65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:46.668898 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2ac0b86a-431d-4d89-9959-efac529c1d65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:46.720521 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-98061076-69ff-4aa6-9c9a-7a63db0c14a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:46.721493 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-98061076-69ff-4aa6-9c9a-7a63db0c14a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:46.728079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-98061076-69ff-4aa6-9c9a-7a63db0c14a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:46.728597 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-98061076-69ff-4aa6-9c9a-7a63db0c14a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:46.729877 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-98061076-69ff-4aa6-9c9a-7a63db0c14a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:46.730599 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-98061076-69ff-4aa6-9c9a-7a63db0c14a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:46.801172 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-2ac0b86a-431d-4d89-9959-efac529c1d65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:46.813444 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2ac0b86a-431d-4d89-9959-efac529c1d65 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1507 microversion: 2.1 time: 0.158863 Nov 12 02:28:46.814017 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 257/487] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:46 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:46.827105 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-98061076-69ff-4aa6-9c9a-7a63db0c14a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.109585 Nov 12 02:28:46.827666 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 231/488] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:46 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:28:46.831204 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a87e9765-e5a6-4d85-a6f3-9e1d334294d5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a63de7f3-2f98-4978-bfde-4a2efa5c7991"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:46.832301 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a87e9765-e5a6-4d85-a6f3-9e1d334294d5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:46.838903 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a87e9765-e5a6-4d85-a6f3-9e1d334294d5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:46.839344 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a87e9765-e5a6-4d85-a6f3-9e1d334294d5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:46.840103 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a87e9765-e5a6-4d85-a6f3-9e1d334294d5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:46.840529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a87e9765-e5a6-4d85-a6f3-9e1d334294d5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:46.914695 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-a87e9765-e5a6-4d85-a6f3-9e1d334294d5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] HTTP exception thrown: Invalid volume: volume a63de7f3-2f98-4978-bfde-4a2efa5c7991 is already attached to instances: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a Nov 12 02:28:46.915254 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a87e9765-e5a6-4d85-a6f3-9e1d334294d5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Returning 400 to user: Invalid volume: volume a63de7f3-2f98-4978-bfde-4a2efa5c7991 is already attached to instances: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:28:46.916180 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a87e9765-e5a6-4d85-a6f3-9e1d334294d5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "POST /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.088830 Nov 12 02:28:46.916723 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 258/489] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:28:46 2021] POST /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e/os-volume_attachments => generated 174 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 12 02:28:46.976473 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d6c9c4b8-c5e5-4215-90eb-3037fdbe52b5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:46.977034 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d6c9c4b8-c5e5-4215-90eb-3037fdbe52b5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:46.979650 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-395d52bf-5485-49ca-8acb-ebc9568c9923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:46.980263 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-395d52bf-5485-49ca-8acb-ebc9568c9923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:46.983094 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6c9c4b8-c5e5-4215-90eb-3037fdbe52b5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:46.983668 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6c9c4b8-c5e5-4215-90eb-3037fdbe52b5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:46.984626 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6c9c4b8-c5e5-4215-90eb-3037fdbe52b5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:46.985141 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6c9c4b8-c5e5-4215-90eb-3037fdbe52b5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:46.988044 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-395d52bf-5485-49ca-8acb-ebc9568c9923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:46.988502 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-395d52bf-5485-49ca-8acb-ebc9568c9923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:46.989504 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-395d52bf-5485-49ca-8acb-ebc9568c9923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:46.989941 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-395d52bf-5485-49ca-8acb-ebc9568c9923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:47.125001 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-d6c9c4b8-c5e5-4215-90eb-3037fdbe52b5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lazy-loading 'services' on Instance uuid 7dc3ef58-e30c-44da-bef1-9678e3c7b14a {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:28:47.155759 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-395d52bf-5485-49ca-8acb-ebc9568c9923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:47.163133 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-395d52bf-5485-49ca-8acb-ebc9568c9923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.187280 Nov 12 02:28:47.163709 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 259/490] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:46 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:47.171761 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d1e8f3dd-e050-4416-8ac0-da74592e64bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:47.172790 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d1e8f3dd-e050-4416-8ac0-da74592e64bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:47.179306 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1e8f3dd-e050-4416-8ac0-da74592e64bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:47.179748 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1e8f3dd-e050-4416-8ac0-da74592e64bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:47.180514 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1e8f3dd-e050-4416-8ac0-da74592e64bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:47.180946 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1e8f3dd-e050-4416-8ac0-da74592e64bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:47.246076 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d6c9c4b8-c5e5-4215-90eb-3037fdbe52b5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a/os-volume_attachments/a63de7f3-2f98-4978-bfde-4a2efa5c7991" status: 202 len: 0 microversion: 2.1 time: 0.273868 Nov 12 02:28:47.246846 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 232/491] 10.222.0.70 () {58 vars in 1415 bytes} [Fri Nov 12 02:28:46 2021] DELETE /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a/os-volume_attachments/a63de7f3-2f98-4978-bfde-4a2efa5c7991 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:47.256799 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5d423bb9-6850-4c65-a9d5-f2d2b10b9135 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:47.258043 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5d423bb9-6850-4c65-a9d5-f2d2b10b9135 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:47.264446 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5d423bb9-6850-4c65-a9d5-f2d2b10b9135 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:47.264888 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5d423bb9-6850-4c65-a9d5-f2d2b10b9135 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:47.266752 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5d423bb9-6850-4c65-a9d5-f2d2b10b9135 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:47.266926 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5d423bb9-6850-4c65-a9d5-f2d2b10b9135 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:47.299436 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d1e8f3dd-e050-4416-8ac0-da74592e64bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.134223 Nov 12 02:28:47.300762 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 260/492] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:47 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:47.306645 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5d423bb9-6850-4c65-a9d5-f2d2b10b9135 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054742 Nov 12 02:28:47.307541 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 233/493] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:28:47 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:28:47.603755 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-67ed30ff-bd4d-4bee-981d-e057a60caadb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:47.604452 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-67ed30ff-bd4d-4bee-981d-e057a60caadb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:47.611303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-67ed30ff-bd4d-4bee-981d-e057a60caadb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:47.611751 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-67ed30ff-bd4d-4bee-981d-e057a60caadb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:47.612529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-67ed30ff-bd4d-4bee-981d-e057a60caadb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:47.612969 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-67ed30ff-bd4d-4bee-981d-e057a60caadb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:47.747758 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-67ed30ff-bd4d-4bee-981d-e057a60caadb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:47.755513 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-67ed30ff-bd4d-4bee-981d-e057a60caadb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.155231 Nov 12 02:28:47.756068 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 261/494] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:47 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:47.839183 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a2f02409-9566-42e0-9b63-5e4e6083031b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:47.840097 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a2f02409-9566-42e0-9b63-5e4e6083031b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:47.846282 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a2f02409-9566-42e0-9b63-5e4e6083031b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:47.846747 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a2f02409-9566-42e0-9b63-5e4e6083031b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:47.847510 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a2f02409-9566-42e0-9b63-5e4e6083031b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:47.847941 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a2f02409-9566-42e0-9b63-5e4e6083031b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:47.952275 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a2f02409-9566-42e0-9b63-5e4e6083031b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.116443 Nov 12 02:28:47.956050 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 234/495] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:47 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:48.179732 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0faba009-7723-4e49-92a9-cf43e9e6c5cf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:48.180340 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0faba009-7723-4e49-92a9-cf43e9e6c5cf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:48.186616 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0faba009-7723-4e49-92a9-cf43e9e6c5cf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:48.187143 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0faba009-7723-4e49-92a9-cf43e9e6c5cf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:48.187898 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0faba009-7723-4e49-92a9-cf43e9e6c5cf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:48.188334 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0faba009-7723-4e49-92a9-cf43e9e6c5cf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:48.312964 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f788e295-c22a-4d53-8a9b-37354b9e0337 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:48.314184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f788e295-c22a-4d53-8a9b-37354b9e0337 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:48.322234 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0faba009-7723-4e49-92a9-cf43e9e6c5cf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:48.322418 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f788e295-c22a-4d53-8a9b-37354b9e0337 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:48.322767 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f788e295-c22a-4d53-8a9b-37354b9e0337 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:48.323559 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f788e295-c22a-4d53-8a9b-37354b9e0337 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:48.323988 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f788e295-c22a-4d53-8a9b-37354b9e0337 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:48.330932 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0faba009-7723-4e49-92a9-cf43e9e6c5cf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.154441 Nov 12 02:28:48.341376 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 262/496] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:48 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:48.346022 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f75727ec-7646-4f98-8ff5-01b3259b8663 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:48.346227 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f75727ec-7646-4f98-8ff5-01b3259b8663 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:48.354657 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f75727ec-7646-4f98-8ff5-01b3259b8663 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:48.355141 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f75727ec-7646-4f98-8ff5-01b3259b8663 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:48.356106 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f75727ec-7646-4f98-8ff5-01b3259b8663 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:48.356758 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f75727ec-7646-4f98-8ff5-01b3259b8663 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:48.389169 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f75727ec-7646-4f98-8ff5-01b3259b8663 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056685 Nov 12 02:28:48.390073 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 263/497] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:28:48 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:28:48.447634 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f788e295-c22a-4d53-8a9b-37354b9e0337 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.138687 Nov 12 02:28:48.448267 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 235/498] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:48 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:28:48.773794 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-53466719-59ec-471b-981f-e814b64e7c9e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:48.774517 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-53466719-59ec-471b-981f-e814b64e7c9e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:48.783621 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-53466719-59ec-471b-981f-e814b64e7c9e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:48.784068 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-53466719-59ec-471b-981f-e814b64e7c9e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:48.784854 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-53466719-59ec-471b-981f-e814b64e7c9e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:48.785300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-53466719-59ec-471b-981f-e814b64e7c9e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:48.922779 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-53466719-59ec-471b-981f-e814b64e7c9e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:48.930696 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-53466719-59ec-471b-981f-e814b64e7c9e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.162234 Nov 12 02:28:48.931259 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 264/499] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:48 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:48.963877 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f15f97f1-c1c2-4587-a098-3e07213f32b0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:48.964892 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f15f97f1-c1c2-4587-a098-3e07213f32b0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:48.971704 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f15f97f1-c1c2-4587-a098-3e07213f32b0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:48.972147 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f15f97f1-c1c2-4587-a098-3e07213f32b0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:48.972952 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f15f97f1-c1c2-4587-a098-3e07213f32b0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:48.973381 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f15f97f1-c1c2-4587-a098-3e07213f32b0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:49.066051 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f15f97f1-c1c2-4587-a098-3e07213f32b0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.105965 Nov 12 02:28:49.066976 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 236/500] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:48 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:49.350436 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-881e178f-a55b-49b4-8599-405d56415651 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:49.351122 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-881e178f-a55b-49b4-8599-405d56415651 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:49.357928 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-881e178f-a55b-49b4-8599-405d56415651 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:49.358286 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-881e178f-a55b-49b4-8599-405d56415651 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:49.359098 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-881e178f-a55b-49b4-8599-405d56415651 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:49.359549 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-881e178f-a55b-49b4-8599-405d56415651 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:49.401221 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7f69734c-e97d-4408-bd82-72874e919335 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:49.402476 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7f69734c-e97d-4408-bd82-72874e919335 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:49.410002 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f69734c-e97d-4408-bd82-72874e919335 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:49.410445 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f69734c-e97d-4408-bd82-72874e919335 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:49.411255 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f69734c-e97d-4408-bd82-72874e919335 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:49.411688 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7f69734c-e97d-4408-bd82-72874e919335 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:49.443510 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7f69734c-e97d-4408-bd82-72874e919335 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045760 Nov 12 02:28:49.444424 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 237/501] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:28:49 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 12 02:28:49.461354 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6f4b85c1-4d1b-45a1-b75f-87c27b256683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:49.462336 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6f4b85c1-4d1b-45a1-b75f-87c27b256683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:49.469621 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f4b85c1-4d1b-45a1-b75f-87c27b256683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:49.470480 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f4b85c1-4d1b-45a1-b75f-87c27b256683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:49.471270 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f4b85c1-4d1b-45a1-b75f-87c27b256683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:49.471759 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f4b85c1-4d1b-45a1-b75f-87c27b256683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:49.522619 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-881e178f-a55b-49b4-8599-405d56415651 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:49.530357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-881e178f-a55b-49b4-8599-405d56415651 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.184299 Nov 12 02:28:49.540396 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 265/502] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:49 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:49.647407 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6f4b85c1-4d1b-45a1-b75f-87c27b256683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28139 microversion: 2.20 time: 0.191349 Nov 12 02:28:49.652646 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 238/503] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:49 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28139 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:28:49.705777 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1485851889", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "networks": [{"uuid": "4070c229-4da3-4ab6-91a8-6b9e74d5d318"}]}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:49.761529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.network.neutron [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] validate_networks() for [('4070c229-4da3-4ab6-91a8-6b9e74d5d318', None, None, None, None, None)] {{(pid=116099) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:28:49.949184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-298b849f-8f9b-4071-82b4-ed397e65638e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:49.950463 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-298b849f-8f9b-4071-82b4-ed397e65638e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:49.962691 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-298b849f-8f9b-4071-82b4-ed397e65638e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:49.963672 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-298b849f-8f9b-4071-82b4-ed397e65638e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:49.964549 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-298b849f-8f9b-4071-82b4-ed397e65638e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:49.965165 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-298b849f-8f9b-4071-82b4-ed397e65638e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:50.253555 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-298b849f-8f9b-4071-82b4-ed397e65638e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:50.261694 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-298b849f-8f9b-4071-82b4-ed397e65638e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.317258 Nov 12 02:28:50.262576 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 239/504] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:49 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:50.278175 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c2c1fa74-bdbf-4145-bd1c-5ae3a88cd585 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:50.279141 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c2c1fa74-bdbf-4145-bd1c-5ae3a88cd585 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:50.286629 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c2c1fa74-bdbf-4145-bd1c-5ae3a88cd585 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:50.287392 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c2c1fa74-bdbf-4145-bd1c-5ae3a88cd585 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:50.288725 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c2c1fa74-bdbf-4145-bd1c-5ae3a88cd585 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:50.289344 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c2c1fa74-bdbf-4145-bd1c-5ae3a88cd585 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:50.369420 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Flavor limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:28:50.369998 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Image limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:28:50.370548 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Flavor pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:28:50.371282 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Image pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:28:50.371716 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:28:50.385067 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:50.385955 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:50.386757 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:50.387559 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:50.399080 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c2c1fa74-bdbf-4145-bd1c-5ae3a88cd585 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28291 microversion: 2.1 time: 0.124773 Nov 12 02:28:50.400332 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 240/505] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:50 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28291 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:50.407026 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Getting quotas for project bf1009072a7446b8a468d02d87b9420d. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:28:50.412836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Getting quotas for user 8f90ce43dddc437fbd6d0531529c6456 and project bf1009072a7446b8a468d02d87b9420d. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:28:50.426473 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Going to run 1 instances... {{(pid=116099) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:28:50.429478 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:28:50.483282 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-be9229b6-c4f6-4ff2-95c0-e7cf5bd27c16 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781109 Nov 12 02:28:50.483918 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 266/506] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:28:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:28:50.495279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-61a90e01-33e0-4859-a8d3-1a705bbfad84 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:50.495983 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-61a90e01-33e0-4859-a8d3-1a705bbfad84 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:50.547795 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-54448609-9f22-4882-8710-4af750508110 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:50.548401 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-54448609-9f22-4882-8710-4af750508110 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:50.555414 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-54448609-9f22-4882-8710-4af750508110 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:50.555864 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-54448609-9f22-4882-8710-4af750508110 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:50.556648 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-54448609-9f22-4882-8710-4af750508110 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:50.557078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-54448609-9f22-4882-8710-4af750508110 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:50.562292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-61a90e01-33e0-4859-a8d3-1a705bbfad84 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:50.570582 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-61a90e01-33e0-4859-a8d3-1a705bbfad84 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1218 microversion: 2.1 time: 0.079732 Nov 12 02:28:50.571387 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 241/507] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:50 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:50.659391 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8be3d814-7408-4d01-a832-f47b23f495d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:50.660357 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8be3d814-7408-4d01-a832-f47b23f495d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:50.667598 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8be3d814-7408-4d01-a832-f47b23f495d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:50.667999 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8be3d814-7408-4d01-a832-f47b23f495d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:50.669471 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8be3d814-7408-4d01-a832-f47b23f495d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:50.669471 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8be3d814-7408-4d01-a832-f47b23f495d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:50.735260 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-54448609-9f22-4882-8710-4af750508110 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:50.743964 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-54448609-9f22-4882-8710-4af750508110 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.199795 Nov 12 02:28:50.744768 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 267/508] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:50 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:50.798849 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8be3d814-7408-4d01-a832-f47b23f495d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28429 microversion: 2.20 time: 0.142851 Nov 12 02:28:50.799532 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 242/509] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:50 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28429 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:51.279623 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a7f9947e-96ff-4843-9300-33343c9d1f5f tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:51.280289 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a7f9947e-96ff-4843-9300-33343c9d1f5f tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:51.286481 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a7f9947e-96ff-4843-9300-33343c9d1f5f tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:51.286947 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a7f9947e-96ff-4843-9300-33343c9d1f5f tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:51.287815 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a7f9947e-96ff-4843-9300-33343c9d1f5f tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:51.288288 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a7f9947e-96ff-4843-9300-33343c9d1f5f tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:51.412654 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9f9c1a12-da76-4c74-b63f-b278150269ad tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:51.414696 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9f9c1a12-da76-4c74-b63f-b278150269ad tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:51.422991 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f9c1a12-da76-4c74-b63f-b278150269ad tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:51.423967 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f9c1a12-da76-4c74-b63f-b278150269ad tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:51.424975 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f9c1a12-da76-4c74-b63f-b278150269ad tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:51.425900 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f9c1a12-da76-4c74-b63f-b278150269ad tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:51.429087 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a7f9947e-96ff-4843-9300-33343c9d1f5f tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:51.437069 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a7f9947e-96ff-4843-9300-33343c9d1f5f tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.161801 Nov 12 02:28:51.437759 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 268/510] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:51 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:51.589234 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b4c21d93-dad4-4e7c-b2a9-700708f04bce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:51.590199 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b4c21d93-dad4-4e7c-b2a9-700708f04bce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:51.590977 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9f9c1a12-da76-4c74-b63f-b278150269ad tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28581 microversion: 2.1 time: 0.182322 Nov 12 02:28:51.591618 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 243/511] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:51 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28581 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:28:51.596611 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4c21d93-dad4-4e7c-b2a9-700708f04bce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:51.597059 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4c21d93-dad4-4e7c-b2a9-700708f04bce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:51.597832 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4c21d93-dad4-4e7c-b2a9-700708f04bce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:51.598259 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4c21d93-dad4-4e7c-b2a9-700708f04bce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:51.672525 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b4c21d93-dad4-4e7c-b2a9-700708f04bce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:51.681215 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b4c21d93-dad4-4e7c-b2a9-700708f04bce tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1278 microversion: 2.1 time: 0.095750 Nov 12 02:28:51.690868 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 269/512] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:51 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:51.762295 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c7cd5080-fe81-40be-9394-12a8d041dccc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:51.763264 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c7cd5080-fe81-40be-9394-12a8d041dccc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:51.772358 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7cd5080-fe81-40be-9394-12a8d041dccc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:51.773278 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7cd5080-fe81-40be-9394-12a8d041dccc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:51.774791 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7cd5080-fe81-40be-9394-12a8d041dccc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:51.775536 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7cd5080-fe81-40be-9394-12a8d041dccc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:51.811261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b3adea5a-ab6d-413a-8715-759cba493318 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:51.812234 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b3adea5a-ab6d-413a-8715-759cba493318 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:51.820394 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b3adea5a-ab6d-413a-8715-759cba493318 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:51.820833 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b3adea5a-ab6d-413a-8715-759cba493318 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:51.822114 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b3adea5a-ab6d-413a-8715-759cba493318 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:51.822756 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b3adea5a-ab6d-413a-8715-759cba493318 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:51.957470 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c7cd5080-fe81-40be-9394-12a8d041dccc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:51.973018 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c7cd5080-fe81-40be-9394-12a8d041dccc tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.214538 Nov 12 02:28:51.974060 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 244/513] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:51 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:51.988949 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b3adea5a-ab6d-413a-8715-759cba493318 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28429 microversion: 2.20 time: 0.180468 Nov 12 02:28:51.990657 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 270/514] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:51 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28429 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:52.456923 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-db9e8ffb-169c-4ebf-82fd-66691fbe62c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:52.458682 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-db9e8ffb-169c-4ebf-82fd-66691fbe62c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:52.468474 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db9e8ffb-169c-4ebf-82fd-66691fbe62c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:52.469045 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db9e8ffb-169c-4ebf-82fd-66691fbe62c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:52.470055 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db9e8ffb-169c-4ebf-82fd-66691fbe62c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:52.470882 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-db9e8ffb-169c-4ebf-82fd-66691fbe62c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:52.611621 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0646f0ee-ba70-479a-a51c-a720b1777358 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:52.613491 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0646f0ee-ba70-479a-a51c-a720b1777358 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:52.628906 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0646f0ee-ba70-479a-a51c-a720b1777358 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:52.629447 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0646f0ee-ba70-479a-a51c-a720b1777358 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:52.630362 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0646f0ee-ba70-479a-a51c-a720b1777358 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:52.630901 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0646f0ee-ba70-479a-a51c-a720b1777358 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:52.649376 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-db9e8ffb-169c-4ebf-82fd-66691fbe62c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:52.659208 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-db9e8ffb-169c-4ebf-82fd-66691fbe62c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.208295 Nov 12 02:28:52.660074 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 245/515] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:52 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:52.697841 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9f91a6a4-67d3-4263-9732-a6622262d2a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:52.698455 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9f91a6a4-67d3-4263-9732-a6622262d2a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:52.705055 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f91a6a4-67d3-4263-9732-a6622262d2a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:52.705512 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f91a6a4-67d3-4263-9732-a6622262d2a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:52.706853 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f91a6a4-67d3-4263-9732-a6622262d2a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:52.707507 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9f91a6a4-67d3-4263-9732-a6622262d2a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:52.764673 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0646f0ee-ba70-479a-a51c-a720b1777358 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.159024 Nov 12 02:28:52.765890 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 271/516] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:52 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:52.915467 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9f91a6a4-67d3-4263-9732-a6622262d2a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:52.925260 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9f91a6a4-67d3-4263-9732-a6622262d2a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1318 microversion: 2.1 time: 0.231495 Nov 12 02:28:52.934772 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 246/517] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:52 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:52.993599 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-820d5f3e-fbbf-494b-bdc0-1b09f72f5376 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:52.994702 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-820d5f3e-fbbf-494b-bdc0-1b09f72f5376 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:53.008334 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4c17d40d-0ee1-4823-a56b-cdd4f0a8d4bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:53.009295 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4c17d40d-0ee1-4823-a56b-cdd4f0a8d4bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:53.009626 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-820d5f3e-fbbf-494b-bdc0-1b09f72f5376 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:53.017245 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-820d5f3e-fbbf-494b-bdc0-1b09f72f5376 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:53.017753 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c17d40d-0ee1-4823-a56b-cdd4f0a8d4bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:53.018250 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-820d5f3e-fbbf-494b-bdc0-1b09f72f5376 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:53.018970 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c17d40d-0ee1-4823-a56b-cdd4f0a8d4bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:53.020270 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c17d40d-0ee1-4823-a56b-cdd4f0a8d4bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:53.021524 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-820d5f3e-fbbf-494b-bdc0-1b09f72f5376 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:53.021688 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c17d40d-0ee1-4823-a56b-cdd4f0a8d4bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:53.213145 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-820d5f3e-fbbf-494b-bdc0-1b09f72f5376 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:53.220507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-820d5f3e-fbbf-494b-bdc0-1b09f72f5376 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.231499 Nov 12 02:28:53.221083 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 272/518] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:52 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:53.311177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4c17d40d-0ee1-4823-a56b-cdd4f0a8d4bf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.310027 Nov 12 02:28:53.314727 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 247/519] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:52 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:53.344228 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-2f69ff58-92e6-474a-bef5-661b9636862b req-95550458-e6da-4f72-83ea-ac2d3b3990a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1199c966-c222-4f06-8d6c-80d247db4c5a", "tag": "8e3501f5-92b1-4fb2-87a9-3b8de8e25091"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:53.345755 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:28:53.345755 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:28:53.353208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-2f69ff58-92e6-474a-bef5-661b9636862b req-95550458-e6da-4f72-83ea-ac2d3b3990a0 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:53.353742 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-2f69ff58-92e6-474a-bef5-661b9636862b req-95550458-e6da-4f72-83ea-ac2d3b3990a0 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:53.368837 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-2f69ff58-92e6-474a-bef5-661b9636862b req-95550458-e6da-4f72-83ea-ac2d3b3990a0 service nova] Creating event network-changed:8e3501f5-92b1-4fb2-87a9-3b8de8e25091 for instance 1199c966-c222-4f06-8d6c-80d247db4c5a on hv-cinder-80857 Nov 12 02:28:53.374255 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-2f69ff58-92e6-474a-bef5-661b9636862b req-95550458-e6da-4f72-83ea-ac2d3b3990a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033614 Nov 12 02:28:53.374991 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 273/520] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:28:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:28:53.685868 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a7d49a78-85c6-49ca-ad23-a449bbe5bd2c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:53.686576 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a7d49a78-85c6-49ca-ad23-a449bbe5bd2c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:53.699344 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a7d49a78-85c6-49ca-ad23-a449bbe5bd2c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:53.701526 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a7d49a78-85c6-49ca-ad23-a449bbe5bd2c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:53.702810 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a7d49a78-85c6-49ca-ad23-a449bbe5bd2c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:53.704168 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a7d49a78-85c6-49ca-ad23-a449bbe5bd2c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:53.781982 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b6c97774-833b-4930-819a-a3199261b188 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:53.786384 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b6c97774-833b-4930-819a-a3199261b188 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:53.809335 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b6c97774-833b-4930-819a-a3199261b188 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:53.809984 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b6c97774-833b-4930-819a-a3199261b188 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:53.811344 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b6c97774-833b-4930-819a-a3199261b188 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:53.812078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b6c97774-833b-4930-819a-a3199261b188 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:53.928718 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b6c97774-833b-4930-819a-a3199261b188 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.154137 Nov 12 02:28:53.930412 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 274/521] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:53 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:53.947048 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2e7bdde7-f447-4fd6-a8d9-36cfb036b697 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:53.949048 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2e7bdde7-f447-4fd6-a8d9-36cfb036b697 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:53.962031 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2e7bdde7-f447-4fd6-a8d9-36cfb036b697 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:53.963521 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2e7bdde7-f447-4fd6-a8d9-36cfb036b697 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:53.965239 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2e7bdde7-f447-4fd6-a8d9-36cfb036b697 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:53.966235 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2e7bdde7-f447-4fd6-a8d9-36cfb036b697 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:53.971750 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a7d49a78-85c6-49ca-ad23-a449bbe5bd2c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:53.980331 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a7d49a78-85c6-49ca-ad23-a449bbe5bd2c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.306741 Nov 12 02:28:53.991164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 248/522] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:53 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:54.138786 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-2e7bdde7-f447-4fd6-a8d9-36cfb036b697 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:54.156998 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2e7bdde7-f447-4fd6-a8d9-36cfb036b697 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1318 microversion: 2.1 time: 0.217112 Nov 12 02:28:54.157715 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 275/523] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:53 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:54.237386 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-175310d4-1133-4e2c-82a6-1b4212e70f1e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:54.238225 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-175310d4-1133-4e2c-82a6-1b4212e70f1e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:54.246360 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-175310d4-1133-4e2c-82a6-1b4212e70f1e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:54.246842 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-175310d4-1133-4e2c-82a6-1b4212e70f1e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:54.247650 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-175310d4-1133-4e2c-82a6-1b4212e70f1e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:54.248085 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-175310d4-1133-4e2c-82a6-1b4212e70f1e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:54.324500 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-92825c6e-9469-444a-bae1-2c1e260d639c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:54.326915 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-92825c6e-9469-444a-bae1-2c1e260d639c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:54.339183 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-92825c6e-9469-444a-bae1-2c1e260d639c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:54.339866 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-92825c6e-9469-444a-bae1-2c1e260d639c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:54.340823 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-92825c6e-9469-444a-bae1-2c1e260d639c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:54.341729 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-92825c6e-9469-444a-bae1-2c1e260d639c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:54.411355 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-175310d4-1133-4e2c-82a6-1b4212e70f1e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:54.422465 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-175310d4-1133-4e2c-82a6-1b4212e70f1e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.188369 Nov 12 02:28:54.423510 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 249/524] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:54 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:54.569799 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-92825c6e-9469-444a-bae1-2c1e260d639c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.250261 Nov 12 02:28:54.570453 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 276/525] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:54 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:28:54.944277 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f878cbd2-5482-488f-8e1c-4d5b5e5c6bf7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:54.945283 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f878cbd2-5482-488f-8e1c-4d5b5e5c6bf7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:54.951398 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f878cbd2-5482-488f-8e1c-4d5b5e5c6bf7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:54.951854 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f878cbd2-5482-488f-8e1c-4d5b5e5c6bf7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:54.952638 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f878cbd2-5482-488f-8e1c-4d5b5e5c6bf7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:54.953090 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f878cbd2-5482-488f-8e1c-4d5b5e5c6bf7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:54.998189 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3ec9c3a6-8757-4f32-8856-4b2ed8c7fd22 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:54.998926 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3ec9c3a6-8757-4f32-8856-4b2ed8c7fd22 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:55.006263 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ec9c3a6-8757-4f32-8856-4b2ed8c7fd22 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:55.006748 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ec9c3a6-8757-4f32-8856-4b2ed8c7fd22 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:55.007665 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ec9c3a6-8757-4f32-8856-4b2ed8c7fd22 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:55.007962 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ec9c3a6-8757-4f32-8856-4b2ed8c7fd22 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:55.136522 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f878cbd2-5482-488f-8e1c-4d5b5e5c6bf7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.196191 Nov 12 02:28:55.137695 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 250/526] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:54 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:55.151263 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3ec9c3a6-8757-4f32-8856-4b2ed8c7fd22 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:55.159494 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3ec9c3a6-8757-4f32-8856-4b2ed8c7fd22 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.164891 Nov 12 02:28:55.159858 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 277/527] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:54 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:55.177189 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-72724982-6d1c-4e5f-807c-61ea3bd2f5e8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:55.177883 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-72724982-6d1c-4e5f-807c-61ea3bd2f5e8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:55.184811 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72724982-6d1c-4e5f-807c-61ea3bd2f5e8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:55.185259 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72724982-6d1c-4e5f-807c-61ea3bd2f5e8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:55.186017 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72724982-6d1c-4e5f-807c-61ea3bd2f5e8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:55.186450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72724982-6d1c-4e5f-807c-61ea3bd2f5e8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:55.329124 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-72724982-6d1c-4e5f-807c-61ea3bd2f5e8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:55.336945 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-72724982-6d1c-4e5f-807c-61ea3bd2f5e8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1318 microversion: 2.1 time: 0.163655 Nov 12 02:28:55.337566 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 251/528] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:55 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:55.439970 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-aba5147d-9a59-40bd-976c-2210d074acc9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:55.440811 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-aba5147d-9a59-40bd-976c-2210d074acc9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:55.447839 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aba5147d-9a59-40bd-976c-2210d074acc9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:55.448511 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aba5147d-9a59-40bd-976c-2210d074acc9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:55.449470 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aba5147d-9a59-40bd-976c-2210d074acc9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:55.450069 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aba5147d-9a59-40bd-976c-2210d074acc9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:55.582146 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-53901f68-10c2-4846-9247-b5f14e9abd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:55.583244 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-53901f68-10c2-4846-9247-b5f14e9abd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:55.592505 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-53901f68-10c2-4846-9247-b5f14e9abd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:55.593043 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-53901f68-10c2-4846-9247-b5f14e9abd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:55.594074 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-53901f68-10c2-4846-9247-b5f14e9abd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:55.594371 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-53901f68-10c2-4846-9247-b5f14e9abd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:55.596765 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-aba5147d-9a59-40bd-976c-2210d074acc9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:55.604372 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-aba5147d-9a59-40bd-976c-2210d074acc9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.168317 Nov 12 02:28:55.604962 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 278/529] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:55 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:55.986459 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-53901f68-10c2-4846-9247-b5f14e9abd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.408041 Nov 12 02:28:55.987142 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 252/530] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:55 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:28:56.149639 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ae52ee5d-ad2a-4e50-bab8-4169e09bfe3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:56.150550 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ae52ee5d-ad2a-4e50-bab8-4169e09bfe3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:56.156836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ae52ee5d-ad2a-4e50-bab8-4169e09bfe3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:56.157275 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ae52ee5d-ad2a-4e50-bab8-4169e09bfe3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:56.158041 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ae52ee5d-ad2a-4e50-bab8-4169e09bfe3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:56.158468 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ae52ee5d-ad2a-4e50-bab8-4169e09bfe3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:56.176179 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c542db69-f132-4b2c-a18b-9d6ac87b028d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:56.176933 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c542db69-f132-4b2c-a18b-9d6ac87b028d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:56.184663 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c542db69-f132-4b2c-a18b-9d6ac87b028d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:56.185122 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c542db69-f132-4b2c-a18b-9d6ac87b028d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:56.186086 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c542db69-f132-4b2c-a18b-9d6ac87b028d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:56.186524 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c542db69-f132-4b2c-a18b-9d6ac87b028d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:56.315181 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ae52ee5d-ad2a-4e50-bab8-4169e09bfe3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.169629 Nov 12 02:28:56.316377 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 279/531] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:56 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:56.327574 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c542db69-f132-4b2c-a18b-9d6ac87b028d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:56.335214 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c542db69-f132-4b2c-a18b-9d6ac87b028d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.163021 Nov 12 02:28:56.335774 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 253/532] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:56 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:56.354687 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-cbaa3cee-d7ba-4abd-b2e6-0ff7e19a743e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:56.355389 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-cbaa3cee-d7ba-4abd-b2e6-0ff7e19a743e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:56.362156 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cbaa3cee-d7ba-4abd-b2e6-0ff7e19a743e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:56.362596 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cbaa3cee-d7ba-4abd-b2e6-0ff7e19a743e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:56.363380 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cbaa3cee-d7ba-4abd-b2e6-0ff7e19a743e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:56.363809 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cbaa3cee-d7ba-4abd-b2e6-0ff7e19a743e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:56.501948 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cbaa3cee-d7ba-4abd-b2e6-0ff7e19a743e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:56.509662 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-cbaa3cee-d7ba-4abd-b2e6-0ff7e19a743e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1318 microversion: 2.1 time: 0.158884 Nov 12 02:28:56.510294 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 280/533] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:56 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:56.599197 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-f3c4ca22-4795-49a5-a7bb-53d9e247b385 req-a48ac8c9-ee69-4d6b-b857-03cce0952a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f436b1-6651-4ba7-88f7-fb2b262f75a5", "name": "network-vif-plugged", "status": "completed", "tag": "1d8b5f9f-4b28-410e-8111-4c6483f94044"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:56.600774 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:28:56.600774 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:28:56.609036 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-f3c4ca22-4795-49a5-a7bb-53d9e247b385 req-a48ac8c9-ee69-4d6b-b857-03cce0952a37 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:56.609308 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-f3c4ca22-4795-49a5-a7bb-53d9e247b385 req-a48ac8c9-ee69-4d6b-b857-03cce0952a37 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:56.623933 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c8bdd000-aee5-4a0c-b248-74c230dfbd53 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:56.624831 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c8bdd000-aee5-4a0c-b248-74c230dfbd53 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:56.626280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-f3c4ca22-4795-49a5-a7bb-53d9e247b385 req-a48ac8c9-ee69-4d6b-b857-03cce0952a37 service nova] Creating event network-vif-plugged:1d8b5f9f-4b28-410e-8111-4c6483f94044 for instance a5f436b1-6651-4ba7-88f7-fb2b262f75a5 on hv-cinder-80857 Nov 12 02:28:56.632928 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-f3c4ca22-4795-49a5-a7bb-53d9e247b385 req-a48ac8c9-ee69-4d6b-b857-03cce0952a37 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036926 Nov 12 02:28:56.633728 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 254/534] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:28:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:28:56.634491 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c8bdd000-aee5-4a0c-b248-74c230dfbd53 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:56.635055 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c8bdd000-aee5-4a0c-b248-74c230dfbd53 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:56.635923 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c8bdd000-aee5-4a0c-b248-74c230dfbd53 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:56.636571 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c8bdd000-aee5-4a0c-b248-74c230dfbd53 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:56.794486 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c8bdd000-aee5-4a0c-b248-74c230dfbd53 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:56.802075 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c8bdd000-aee5-4a0c-b248-74c230dfbd53 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.184467 Nov 12 02:28:56.802760 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 281/535] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:56 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:56.999184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7bc6847a-779d-4656-b32c-39a001d00b7d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:57.000212 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7bc6847a-779d-4656-b32c-39a001d00b7d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:57.007646 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7bc6847a-779d-4656-b32c-39a001d00b7d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:57.007873 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7bc6847a-779d-4656-b32c-39a001d00b7d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:57.008659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7bc6847a-779d-4656-b32c-39a001d00b7d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:57.009101 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7bc6847a-779d-4656-b32c-39a001d00b7d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:57.327341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4c33bdc9-8567-40f8-a343-2961d0dc8ed9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:57.328307 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4c33bdc9-8567-40f8-a343-2961d0dc8ed9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:57.334468 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4c33bdc9-8567-40f8-a343-2961d0dc8ed9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:57.335011 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4c33bdc9-8567-40f8-a343-2961d0dc8ed9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:57.336074 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4c33bdc9-8567-40f8-a343-2961d0dc8ed9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:57.336533 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4c33bdc9-8567-40f8-a343-2961d0dc8ed9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:57.601852 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7bc6847a-779d-4656-b32c-39a001d00b7d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.606540 Nov 12 02:28:57.602500 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 255/536] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:56 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:57.607569 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a60bf35b-f901-4100-b363-4f87812640e7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:57.608253 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a60bf35b-f901-4100-b363-4f87812640e7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:57.615879 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a60bf35b-f901-4100-b363-4f87812640e7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:57.616316 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a60bf35b-f901-4100-b363-4f87812640e7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:57.617081 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a60bf35b-f901-4100-b363-4f87812640e7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:57.617775 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a60bf35b-f901-4100-b363-4f87812640e7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:57.746995 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4c33bdc9-8567-40f8-a343-2961d0dc8ed9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.423080 Nov 12 02:28:57.748180 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 282/537] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:57 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:28:57.752979 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-af31c945-4511-423e-b607-814679bb8ccf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:57.753667 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-af31c945-4511-423e-b607-814679bb8ccf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:57.759280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a60bf35b-f901-4100-b363-4f87812640e7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:57.760827 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-af31c945-4511-423e-b607-814679bb8ccf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:57.761348 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-af31c945-4511-423e-b607-814679bb8ccf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:57.762134 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-af31c945-4511-423e-b607-814679bb8ccf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:57.762618 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-af31c945-4511-423e-b607-814679bb8ccf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:57.766608 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a60bf35b-f901-4100-b363-4f87812640e7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.162855 Nov 12 02:28:57.767205 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 256/538] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:57 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:57.819665 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0cd2984c-7f80-4fda-8053-889adcdc3b36 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:57.820374 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0cd2984c-7f80-4fda-8053-889adcdc3b36 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:57.827314 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0cd2984c-7f80-4fda-8053-889adcdc3b36 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:57.827771 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0cd2984c-7f80-4fda-8053-889adcdc3b36 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:57.828540 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0cd2984c-7f80-4fda-8053-889adcdc3b36 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:57.828936 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0cd2984c-7f80-4fda-8053-889adcdc3b36 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:57.944038 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-af31c945-4511-423e-b607-814679bb8ccf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:57.952460 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-af31c945-4511-423e-b607-814679bb8ccf tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1318 microversion: 2.1 time: 0.203074 Nov 12 02:28:57.953141 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 283/539] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:57 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:58.014715 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0cd2984c-7f80-4fda-8053-889adcdc3b36 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:58.023109 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0cd2984c-7f80-4fda-8053-889adcdc3b36 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1499 microversion: 2.1 time: 0.207877 Nov 12 02:28:58.028157 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 257/540] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:57 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1499 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:28:58.039213 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-221b8315-f919-4431-9669-8d30bf36d0f6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46ab72b6-55aa-4863-9c85-e8458583e196"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:58.040344 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-221b8315-f919-4431-9669-8d30bf36d0f6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:58.046544 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-221b8315-f919-4431-9669-8d30bf36d0f6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:58.047026 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-221b8315-f919-4431-9669-8d30bf36d0f6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:58.047904 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-221b8315-f919-4431-9669-8d30bf36d0f6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:58.048364 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-221b8315-f919-4431-9669-8d30bf36d0f6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:58.072003 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-221b8315-f919-4431-9669-8d30bf36d0f6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] HTTP exception thrown: Cannot 'attach_volume' instance 44c025f0-3bb5-4ce5-944f-0f553ef80f8a while it is in vm_state rescued Nov 12 02:28:58.072511 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-221b8315-f919-4431-9669-8d30bf36d0f6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Returning 409 to user: Cannot 'attach_volume' instance 44c025f0-3bb5-4ce5-944f-0f553ef80f8a while it is in vm_state rescued {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:28:58.073435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-221b8315-f919-4431-9669-8d30bf36d0f6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "POST /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038199 Nov 12 02:28:58.074095 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 284/541] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:28:58 2021] POST /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments => generated 152 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 12 02:28:58.082658 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-767a5e12-3e0d-4925-bbac-9238928d8739 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:58.083781 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-767a5e12-3e0d-4925-bbac-9238928d8739 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:58.089810 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-767a5e12-3e0d-4925-bbac-9238928d8739 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:58.090270 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-767a5e12-3e0d-4925-bbac-9238928d8739 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:58.091083 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-767a5e12-3e0d-4925-bbac-9238928d8739 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:58.091519 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-767a5e12-3e0d-4925-bbac-9238928d8739 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:58.163809 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-767a5e12-3e0d-4925-bbac-9238928d8739 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "POST /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/action" status: 202 len: 0 microversion: 2.1 time: 0.084517 Nov 12 02:28:58.164540 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 258/542] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:58 2021] POST /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:28:58.178719 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1c5bce78-bbf8-4a70-b598-21724be27dc5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:58.179383 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1c5bce78-bbf8-4a70-b598-21724be27dc5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:58.190946 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1c5bce78-bbf8-4a70-b598-21724be27dc5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:58.191847 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1c5bce78-bbf8-4a70-b598-21724be27dc5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:58.193741 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1c5bce78-bbf8-4a70-b598-21724be27dc5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:58.194601 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1c5bce78-bbf8-4a70-b598-21724be27dc5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:58.336507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1c5bce78-bbf8-4a70-b598-21724be27dc5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:58.346520 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1c5bce78-bbf8-4a70-b598-21724be27dc5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1507 microversion: 2.1 time: 0.177149 Nov 12 02:28:58.347264 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 285/543] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:58 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:58.615994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ad7fdd4e-f8be-45e2-822f-23421fbecf75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:58.617857 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ad7fdd4e-f8be-45e2-822f-23421fbecf75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:58.625397 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ad7fdd4e-f8be-45e2-822f-23421fbecf75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:58.626045 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ad7fdd4e-f8be-45e2-822f-23421fbecf75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:58.627226 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ad7fdd4e-f8be-45e2-822f-23421fbecf75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:58.627841 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ad7fdd4e-f8be-45e2-822f-23421fbecf75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:58.760221 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-18f2bbc0-1033-425e-8de2-be093d5a9a8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:58.762180 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-18f2bbc0-1033-425e-8de2-be093d5a9a8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:58.768502 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18f2bbc0-1033-425e-8de2-be093d5a9a8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:58.769121 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18f2bbc0-1033-425e-8de2-be093d5a9a8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:58.770041 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18f2bbc0-1033-425e-8de2-be093d5a9a8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:58.770576 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18f2bbc0-1033-425e-8de2-be093d5a9a8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:58.866215 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ad7fdd4e-f8be-45e2-822f-23421fbecf75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.256188 Nov 12 02:28:58.870415 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 259/544] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:58 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:28:58.871996 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f332155b-32d5-47c7-beb3-4c806de6611d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:58.872905 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f332155b-32d5-47c7-beb3-4c806de6611d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:58.879859 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f332155b-32d5-47c7-beb3-4c806de6611d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:58.880345 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f332155b-32d5-47c7-beb3-4c806de6611d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:58.881254 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f332155b-32d5-47c7-beb3-4c806de6611d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:58.881689 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f332155b-32d5-47c7-beb3-4c806de6611d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:59.006928 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-18f2bbc0-1033-425e-8de2-be093d5a9a8a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.250232 Nov 12 02:28:59.007718 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 286/545] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:28:58 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:28:59.012921 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e842179b-d26a-47c5-8bd1-a3abae46ea91 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:59.013728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e842179b-d26a-47c5-8bd1-a3abae46ea91 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:59.021358 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e842179b-d26a-47c5-8bd1-a3abae46ea91 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:59.022189 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e842179b-d26a-47c5-8bd1-a3abae46ea91 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:59.023324 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e842179b-d26a-47c5-8bd1-a3abae46ea91 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:59.023846 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e842179b-d26a-47c5-8bd1-a3abae46ea91 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:59.033216 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f332155b-32d5-47c7-beb3-4c806de6611d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:59.041724 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f332155b-32d5-47c7-beb3-4c806de6611d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1265 microversion: 2.1 time: 0.173409 Nov 12 02:28:59.042417 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 260/546] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:58 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:59.165917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e842179b-d26a-47c5-8bd1-a3abae46ea91 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:59.173108 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e842179b-d26a-47c5-8bd1-a3abae46ea91 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1318 microversion: 2.1 time: 0.163938 Nov 12 02:28:59.173659 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 287/547] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:59 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:59.364234 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d64a23c7-9238-481c-a12e-4d57deaf74ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:28:59.365081 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d64a23c7-9238-481c-a12e-4d57deaf74ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:59.375412 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d64a23c7-9238-481c-a12e-4d57deaf74ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:59.377764 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d64a23c7-9238-481c-a12e-4d57deaf74ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:59.379108 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d64a23c7-9238-481c-a12e-4d57deaf74ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:59.379578 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d64a23c7-9238-481c-a12e-4d57deaf74ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:59.531786 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d64a23c7-9238-481c-a12e-4d57deaf74ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:28:59.538939 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d64a23c7-9238-481c-a12e-4d57deaf74ee tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1507 microversion: 2.1 time: 0.178506 Nov 12 02:28:59.539634 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 261/548] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:28:59 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:28:59.877158 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f3649cad-f1ff-4695-9ae3-7b6d076beac3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:28:59.878111 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f3649cad-f1ff-4695-9ae3-7b6d076beac3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:28:59.885341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f3649cad-f1ff-4695-9ae3-7b6d076beac3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:59.886306 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f3649cad-f1ff-4695-9ae3-7b6d076beac3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:28:59.887227 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f3649cad-f1ff-4695-9ae3-7b6d076beac3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:28:59.887720 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f3649cad-f1ff-4695-9ae3-7b6d076beac3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:00.018804 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a97c68ef-048c-4007-99e4-5b739ea4f59e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:00.019946 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a97c68ef-048c-4007-99e4-5b739ea4f59e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:00.027082 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a97c68ef-048c-4007-99e4-5b739ea4f59e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:00.027608 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a97c68ef-048c-4007-99e4-5b739ea4f59e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:00.028320 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a97c68ef-048c-4007-99e4-5b739ea4f59e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:00.028729 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a97c68ef-048c-4007-99e4-5b739ea4f59e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:00.103824 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f3649cad-f1ff-4695-9ae3-7b6d076beac3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.230213 Nov 12 02:29:00.104467 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 288/549] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:28:59 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:00.109367 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-14d45be9-2634-4622-ade7-b9902e4a5303 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:00.110075 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-14d45be9-2634-4622-ade7-b9902e4a5303 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:00.117295 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-14d45be9-2634-4622-ade7-b9902e4a5303 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:00.117991 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-14d45be9-2634-4622-ade7-b9902e4a5303 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:00.118806 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-14d45be9-2634-4622-ade7-b9902e4a5303 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:00.119238 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-14d45be9-2634-4622-ade7-b9902e4a5303 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:00.150836 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a97c68ef-048c-4007-99e4-5b739ea4f59e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.131079 Nov 12 02:29:00.152106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 262/550] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:00 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:00.190573 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-60f73343-fb05-43ee-a4fa-66b33ebe4864 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:00.191263 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-60f73343-fb05-43ee-a4fa-66b33ebe4864 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:00.199485 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60f73343-fb05-43ee-a4fa-66b33ebe4864 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:00.199963 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60f73343-fb05-43ee-a4fa-66b33ebe4864 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:00.200750 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60f73343-fb05-43ee-a4fa-66b33ebe4864 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:00.201346 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60f73343-fb05-43ee-a4fa-66b33ebe4864 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:00.325530 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-14d45be9-2634-4622-ade7-b9902e4a5303 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:00.334538 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-14d45be9-2634-4622-ade7-b9902e4a5303 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1451 microversion: 2.1 time: 0.228778 Nov 12 02:29:00.335633 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 289/551] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:00 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1451 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:00.355532 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2f475070-5d6f-4757-b632-fe4262fe5fc1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:00.356143 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2f475070-5d6f-4757-b632-fe4262fe5fc1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:00.362180 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2f475070-5d6f-4757-b632-fe4262fe5fc1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:00.362624 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2f475070-5d6f-4757-b632-fe4262fe5fc1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:00.363570 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2f475070-5d6f-4757-b632-fe4262fe5fc1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:00.364184 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2f475070-5d6f-4757-b632-fe4262fe5fc1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:00.418486 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-60f73343-fb05-43ee-a4fa-66b33ebe4864 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:00.427849 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-60f73343-fb05-43ee-a4fa-66b33ebe4864 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1318 microversion: 2.1 time: 0.240833 Nov 12 02:29:00.428572 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 263/552] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:00 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:00.518542 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-2f475070-5d6f-4757-b632-fe4262fe5fc1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:00.526248 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2f475070-5d6f-4757-b632-fe4262fe5fc1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1451 microversion: 2.1 time: 0.175129 Nov 12 02:29:00.526843 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 290/553] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:00 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:00.560769 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bfc31e64-0591-4a05-8fc5-0b1ac35d18d4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:00.561902 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bfc31e64-0591-4a05-8fc5-0b1ac35d18d4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:00.571422 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bfc31e64-0591-4a05-8fc5-0b1ac35d18d4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:00.571873 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bfc31e64-0591-4a05-8fc5-0b1ac35d18d4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:00.577126 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bfc31e64-0591-4a05-8fc5-0b1ac35d18d4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:00.577126 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bfc31e64-0591-4a05-8fc5-0b1ac35d18d4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:00.748103 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bfc31e64-0591-4a05-8fc5-0b1ac35d18d4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:00.755545 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bfc31e64-0591-4a05-8fc5-0b1ac35d18d4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1507 microversion: 2.1 time: 0.201227 Nov 12 02:29:00.756125 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 264/554] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:00 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:01.116951 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4a9888ef-c0a1-4501-baa7-dff0b0f03965 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:01.119283 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4a9888ef-c0a1-4501-baa7-dff0b0f03965 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:01.126723 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a9888ef-c0a1-4501-baa7-dff0b0f03965 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:01.127344 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a9888ef-c0a1-4501-baa7-dff0b0f03965 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:01.128524 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a9888ef-c0a1-4501-baa7-dff0b0f03965 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:01.129114 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a9888ef-c0a1-4501-baa7-dff0b0f03965 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:01.164275 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-12a66b2d-ca66-4f96-b88b-e5ca446e8210 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:01.166526 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-12a66b2d-ca66-4f96-b88b-e5ca446e8210 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:01.174368 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-12a66b2d-ca66-4f96-b88b-e5ca446e8210 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:01.176034 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-12a66b2d-ca66-4f96-b88b-e5ca446e8210 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:01.177173 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-12a66b2d-ca66-4f96-b88b-e5ca446e8210 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:01.177863 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-12a66b2d-ca66-4f96-b88b-e5ca446e8210 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:01.265175 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4a9888ef-c0a1-4501-baa7-dff0b0f03965 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.151847 Nov 12 02:29:01.269208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 291/555] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:01 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:01.293545 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-12a66b2d-ca66-4f96-b88b-e5ca446e8210 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.133554 Nov 12 02:29:01.294804 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 265/556] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:01 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:01.447179 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4786f7d4-1a24-4da8-bd4d-248a5e269a8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:01.448001 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4786f7d4-1a24-4da8-bd4d-248a5e269a8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:01.455042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4786f7d4-1a24-4da8-bd4d-248a5e269a8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:01.455578 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4786f7d4-1a24-4da8-bd4d-248a5e269a8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:01.456423 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4786f7d4-1a24-4da8-bd4d-248a5e269a8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:01.456925 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4786f7d4-1a24-4da8-bd4d-248a5e269a8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:01.738356 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4786f7d4-1a24-4da8-bd4d-248a5e269a8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:01.749467 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4786f7d4-1a24-4da8-bd4d-248a5e269a8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1318 microversion: 2.1 time: 0.307128 Nov 12 02:29:01.750038 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 292/557] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:01 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:01.773861 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5e0b7e62-38fd-435a-a4b0-e4f39b2d6b0c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:01.775032 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5e0b7e62-38fd-435a-a4b0-e4f39b2d6b0c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:01.783686 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e0b7e62-38fd-435a-a4b0-e4f39b2d6b0c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:01.784142 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e0b7e62-38fd-435a-a4b0-e4f39b2d6b0c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:01.784984 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e0b7e62-38fd-435a-a4b0-e4f39b2d6b0c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:01.785388 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e0b7e62-38fd-435a-a4b0-e4f39b2d6b0c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:02.277758 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fbb0f350-f307-4092-8425-184199232fa8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:02.279338 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-fbb0f350-f307-4092-8425-184199232fa8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:02.287780 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fbb0f350-f307-4092-8425-184199232fa8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:02.288241 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fbb0f350-f307-4092-8425-184199232fa8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:02.289290 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fbb0f350-f307-4092-8425-184199232fa8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:02.290293 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fbb0f350-f307-4092-8425-184199232fa8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:02.309010 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5e0b7e62-38fd-435a-a4b0-e4f39b2d6b0c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:02.320792 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5e0b7e62-38fd-435a-a4b0-e4f39b2d6b0c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1507 microversion: 2.1 time: 0.551490 Nov 12 02:29:02.321367 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 266/558] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:01 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1507 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:02.328648 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5580ca80-4ad3-4a24-a843-82b4ccc8cbbb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:02.333652 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5580ca80-4ad3-4a24-a843-82b4ccc8cbbb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:02.346588 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5580ca80-4ad3-4a24-a843-82b4ccc8cbbb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:02.347074 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5580ca80-4ad3-4a24-a843-82b4ccc8cbbb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:02.347880 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5580ca80-4ad3-4a24-a843-82b4ccc8cbbb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:02.348324 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5580ca80-4ad3-4a24-a843-82b4ccc8cbbb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:02.545589 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-fbb0f350-f307-4092-8425-184199232fa8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.271067 Nov 12 02:29:02.553131 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 293/559] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:02 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:29:02.579152 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5580ca80-4ad3-4a24-a843-82b4ccc8cbbb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.249823 Nov 12 02:29:02.579152 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 267/560] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:02 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:02.719536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-154fa807-b9c3-4bae-80df-88f8c09f506d req-bff4f325-7daf-4341-a8de-9e036d5c4336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1199c966-c222-4f06-8d6c-80d247db4c5a", "name": "network-vif-plugged", "status": "completed", "tag": "8e3501f5-92b1-4fb2-87a9-3b8de8e25091"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:02.721172 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:29:02.721172 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:29:02.745581 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-154fa807-b9c3-4bae-80df-88f8c09f506d req-bff4f325-7daf-4341-a8de-9e036d5c4336 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:02.746057 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-154fa807-b9c3-4bae-80df-88f8c09f506d req-bff4f325-7daf-4341-a8de-9e036d5c4336 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:02.776570 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e1d6ec3e-6183-4d74-8da5-894fba3a67f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:02.778201 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e1d6ec3e-6183-4d74-8da5-894fba3a67f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:02.784843 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-154fa807-b9c3-4bae-80df-88f8c09f506d req-bff4f325-7daf-4341-a8de-9e036d5c4336 service nova] Creating event network-vif-plugged:8e3501f5-92b1-4fb2-87a9-3b8de8e25091 for instance 1199c966-c222-4f06-8d6c-80d247db4c5a on hv-cinder-80857 Nov 12 02:29:02.792319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e1d6ec3e-6183-4d74-8da5-894fba3a67f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:02.793504 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e1d6ec3e-6183-4d74-8da5-894fba3a67f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:02.795256 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e1d6ec3e-6183-4d74-8da5-894fba3a67f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:02.796242 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e1d6ec3e-6183-4d74-8da5-894fba3a67f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:02.799959 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-154fa807-b9c3-4bae-80df-88f8c09f506d req-bff4f325-7daf-4341-a8de-9e036d5c4336 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085716 Nov 12 02:29:02.800879 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 294/561] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:29:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:29:03.109564 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e1d6ec3e-6183-4d74-8da5-894fba3a67f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:03.118499 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e1d6ec3e-6183-4d74-8da5-894fba3a67f9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1318 microversion: 2.1 time: 0.352528 Nov 12 02:29:03.119613 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 268/562] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:02 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:03.346813 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-dafd873f-9732-4b06-90c4-2be330639510 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:03.348345 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-dafd873f-9732-4b06-90c4-2be330639510 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:03.356861 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dafd873f-9732-4b06-90c4-2be330639510 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:03.357853 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dafd873f-9732-4b06-90c4-2be330639510 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:03.358757 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dafd873f-9732-4b06-90c4-2be330639510 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:03.359718 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dafd873f-9732-4b06-90c4-2be330639510 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:03.398352 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-0865c7fa-bc87-46e8-9db6-90538bf8b080 req-35b2c9cc-d245-430d-880e-c51f8ccddd2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f436b1-6651-4ba7-88f7-fb2b262f75a5", "tag": "1d8b5f9f-4b28-410e-8111-4c6483f94044"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:03.401000 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:29:03.401000 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:29:03.411736 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-0865c7fa-bc87-46e8-9db6-90538bf8b080 req-35b2c9cc-d245-430d-880e-c51f8ccddd2c service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:03.411736 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-0865c7fa-bc87-46e8-9db6-90538bf8b080 req-35b2c9cc-d245-430d-880e-c51f8ccddd2c service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:03.423061 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-0865c7fa-bc87-46e8-9db6-90538bf8b080 req-35b2c9cc-d245-430d-880e-c51f8ccddd2c service nova] Creating event network-changed:1d8b5f9f-4b28-410e-8111-4c6483f94044 for instance a5f436b1-6651-4ba7-88f7-fb2b262f75a5 on hv-cinder-80857 Nov 12 02:29:03.428829 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-0865c7fa-bc87-46e8-9db6-90538bf8b080 req-35b2c9cc-d245-430d-880e-c51f8ccddd2c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035541 Nov 12 02:29:03.429874 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 269/563] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:29:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:29:03.534114 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-dafd873f-9732-4b06-90c4-2be330639510 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:03.542238 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-dafd873f-9732-4b06-90c4-2be330639510 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1513 microversion: 2.1 time: 0.200416 Nov 12 02:29:03.542801 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 295/564] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:03 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:03.563371 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d3c30287-c056-4a37-b391-c3740c1232e5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:03.564776 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d3c30287-c056-4a37-b391-c3740c1232e5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:03.575973 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d3c30287-c056-4a37-b391-c3740c1232e5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:03.576591 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d3c30287-c056-4a37-b391-c3740c1232e5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:03.577596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d3c30287-c056-4a37-b391-c3740c1232e5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:03.578183 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d3c30287-c056-4a37-b391-c3740c1232e5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:03.588116 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-331dd0a1-15b3-48df-ac18-d2423421c145 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:03.589631 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-331dd0a1-15b3-48df-ac18-d2423421c145 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:03.601035 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-331dd0a1-15b3-48df-ac18-d2423421c145 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:03.601509 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-331dd0a1-15b3-48df-ac18-d2423421c145 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:03.602285 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-331dd0a1-15b3-48df-ac18-d2423421c145 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:03.602772 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-331dd0a1-15b3-48df-ac18-d2423421c145 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:03.834195 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d3c30287-c056-4a37-b391-c3740c1232e5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.276137 Nov 12 02:29:03.835087 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 270/565] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:03 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:03.858294 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-331dd0a1-15b3-48df-ac18-d2423421c145 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.273789 Nov 12 02:29:03.859813 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 296/566] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:03 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:04.138042 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f7cb3eb7-8fc9-4099-a5bc-8282a87caaa2 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:04.139467 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f7cb3eb7-8fc9-4099-a5bc-8282a87caaa2 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:04.150420 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7cb3eb7-8fc9-4099-a5bc-8282a87caaa2 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:04.154162 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7cb3eb7-8fc9-4099-a5bc-8282a87caaa2 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:04.155316 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7cb3eb7-8fc9-4099-a5bc-8282a87caaa2 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:04.155950 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7cb3eb7-8fc9-4099-a5bc-8282a87caaa2 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:04.330302 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f7cb3eb7-8fc9-4099-a5bc-8282a87caaa2 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:04.341215 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f7cb3eb7-8fc9-4099-a5bc-8282a87caaa2 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1318 microversion: 2.1 time: 0.208394 Nov 12 02:29:04.347376 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 271/567] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:04 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:04.845926 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6ae6eabc-7a7a-4d4c-bea6-59c8b45c6182 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:04.847021 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6ae6eabc-7a7a-4d4c-bea6-59c8b45c6182 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:04.855724 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ae6eabc-7a7a-4d4c-bea6-59c8b45c6182 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:04.856783 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ae6eabc-7a7a-4d4c-bea6-59c8b45c6182 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:04.863054 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ae6eabc-7a7a-4d4c-bea6-59c8b45c6182 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:04.863591 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ae6eabc-7a7a-4d4c-bea6-59c8b45c6182 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:04.870704 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c9dab504-7d17-4fab-95ac-1ab43bf6d28e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:04.874736 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c9dab504-7d17-4fab-95ac-1ab43bf6d28e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:04.883609 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9dab504-7d17-4fab-95ac-1ab43bf6d28e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:04.884639 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9dab504-7d17-4fab-95ac-1ab43bf6d28e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:04.889544 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9dab504-7d17-4fab-95ac-1ab43bf6d28e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:04.891035 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9dab504-7d17-4fab-95ac-1ab43bf6d28e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:05.096365 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6ae6eabc-7a7a-4d4c-bea6-59c8b45c6182 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.254274 Nov 12 02:29:05.100842 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 297/568] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:04 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:29:05.102785 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2289c7d8-ccf1-43c7-910b-36cc61753928 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:05.103549 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2289c7d8-ccf1-43c7-910b-36cc61753928 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:05.110937 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2289c7d8-ccf1-43c7-910b-36cc61753928 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:05.111524 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2289c7d8-ccf1-43c7-910b-36cc61753928 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:05.112358 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2289c7d8-ccf1-43c7-910b-36cc61753928 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:05.112742 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2289c7d8-ccf1-43c7-910b-36cc61753928 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:05.141240 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c9dab504-7d17-4fab-95ac-1ab43bf6d28e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.274281 Nov 12 02:29:05.162733 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 272/569] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:04 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:05.272321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-2289c7d8-ccf1-43c7-910b-36cc61753928 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:05.283998 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2289c7d8-ccf1-43c7-910b-36cc61753928 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1513 microversion: 2.1 time: 0.185623 Nov 12 02:29:05.284871 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 298/570] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:05 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:05.302183 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-eff36fe3-533b-45f2-a0db-bc52821ffd48 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b41d7ae-d719-437a-b7e8-42ba79f34a0d"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:05.303854 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-eff36fe3-533b-45f2-a0db-bc52821ffd48 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:05.310595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eff36fe3-533b-45f2-a0db-bc52821ffd48 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:05.311070 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eff36fe3-533b-45f2-a0db-bc52821ffd48 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:05.312245 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eff36fe3-533b-45f2-a0db-bc52821ffd48 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:05.312699 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eff36fe3-533b-45f2-a0db-bc52821ffd48 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:05.361102 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3d82509f-d5cf-4091-98da-a728b776c29a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:05.361638 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3d82509f-d5cf-4091-98da-a728b776c29a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:05.369682 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d82509f-d5cf-4091-98da-a728b776c29a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:05.370416 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d82509f-d5cf-4091-98da-a728b776c29a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:05.371387 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d82509f-d5cf-4091-98da-a728b776c29a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:05.372002 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d82509f-d5cf-4091-98da-a728b776c29a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:05.540556 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3d82509f-d5cf-4091-98da-a728b776c29a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:05.549137 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3d82509f-d5cf-4091-98da-a728b776c29a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1508 microversion: 2.1 time: 0.191699 Nov 12 02:29:05.550047 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 299/571] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:05 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:05.647680 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-eff36fe3-533b-45f2-a0db-bc52821ffd48 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "POST /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349178 Nov 12 02:29:05.648328 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 273/572] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:29:05 2021] POST /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:29:06.108452 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3985182a-0e87-40b0-9301-e4413b488593 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:06.109507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3985182a-0e87-40b0-9301-e4413b488593 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:06.116857 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3985182a-0e87-40b0-9301-e4413b488593 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:06.117313 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3985182a-0e87-40b0-9301-e4413b488593 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:06.118392 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3985182a-0e87-40b0-9301-e4413b488593 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:06.118860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3985182a-0e87-40b0-9301-e4413b488593 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:06.155533 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b6029562-9f9d-4778-8836-6bf1f0d860e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:06.157544 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b6029562-9f9d-4778-8836-6bf1f0d860e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:06.165011 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6029562-9f9d-4778-8836-6bf1f0d860e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:06.165558 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6029562-9f9d-4778-8836-6bf1f0d860e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:06.166489 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6029562-9f9d-4778-8836-6bf1f0d860e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:06.167024 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b6029562-9f9d-4778-8836-6bf1f0d860e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:06.227186 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3985182a-0e87-40b0-9301-e4413b488593 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.122156 Nov 12 02:29:06.227984 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 300/573] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:06 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:06.307162 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b6029562-9f9d-4778-8836-6bf1f0d860e1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.156228 Nov 12 02:29:06.311150 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 274/574] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:06 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:07.240525 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e280f275-4995-4e21-88f9-6117c70ef8a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:07.241853 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e280f275-4995-4e21-88f9-6117c70ef8a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:07.250025 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e280f275-4995-4e21-88f9-6117c70ef8a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:07.250459 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e280f275-4995-4e21-88f9-6117c70ef8a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:07.251273 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e280f275-4995-4e21-88f9-6117c70ef8a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:07.251703 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e280f275-4995-4e21-88f9-6117c70ef8a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:07.320707 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-be1f529b-2361-4647-bdaf-da18925136b4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:07.321769 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-be1f529b-2361-4647-bdaf-da18925136b4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:07.328784 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be1f529b-2361-4647-bdaf-da18925136b4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:07.329159 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be1f529b-2361-4647-bdaf-da18925136b4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:07.329941 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be1f529b-2361-4647-bdaf-da18925136b4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:07.330378 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be1f529b-2361-4647-bdaf-da18925136b4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:07.355244 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e280f275-4995-4e21-88f9-6117c70ef8a8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.118768 Nov 12 02:29:07.356778 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 301/575] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:07 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:07.454979 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-be1f529b-2361-4647-bdaf-da18925136b4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.139381 Nov 12 02:29:07.455651 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 275/576] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:07 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:08.042982 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8462e648-c204-4b92-9e54-0f389d911a7b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3f44ca5-f811-4896-81e9-67e8c97b504e"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:08.044121 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8462e648-c204-4b92-9e54-0f389d911a7b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:08.051441 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8462e648-c204-4b92-9e54-0f389d911a7b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:08.052433 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8462e648-c204-4b92-9e54-0f389d911a7b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:08.053215 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8462e648-c204-4b92-9e54-0f389d911a7b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:08.053639 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8462e648-c204-4b92-9e54-0f389d911a7b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:08.331439 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8462e648-c204-4b92-9e54-0f389d911a7b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "POST /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292403 Nov 12 02:29:08.332120 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 302/577] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:29:08 2021] POST /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:29:08.367366 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f702b5e3-4f4e-4191-8c88-e076228e56a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:08.368815 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f702b5e3-4f4e-4191-8c88-e076228e56a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:08.376304 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f702b5e3-4f4e-4191-8c88-e076228e56a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:08.376755 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f702b5e3-4f4e-4191-8c88-e076228e56a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:08.377543 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f702b5e3-4f4e-4191-8c88-e076228e56a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:08.377994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f702b5e3-4f4e-4191-8c88-e076228e56a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:08.471033 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-02fca94a-cb95-45b2-911f-607d9eb521bc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:08.472152 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-02fca94a-cb95-45b2-911f-607d9eb521bc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:08.477554 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f702b5e3-4f4e-4191-8c88-e076228e56a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.114198 Nov 12 02:29:08.478243 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 276/578] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:08 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:08.479758 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-02fca94a-cb95-45b2-911f-607d9eb521bc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:08.480342 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-02fca94a-cb95-45b2-911f-607d9eb521bc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:08.481540 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-02fca94a-cb95-45b2-911f-607d9eb521bc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:08.482098 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-02fca94a-cb95-45b2-911f-607d9eb521bc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:08.596958 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-02fca94a-cb95-45b2-911f-607d9eb521bc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.130388 Nov 12 02:29:08.597628 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 303/579] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:08 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:09.490325 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-206e29a4-9d87-4515-8533-39428b169683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:09.491365 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-206e29a4-9d87-4515-8533-39428b169683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:09.499707 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-206e29a4-9d87-4515-8533-39428b169683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:09.500161 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-206e29a4-9d87-4515-8533-39428b169683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:09.500947 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-206e29a4-9d87-4515-8533-39428b169683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:09.501387 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-206e29a4-9d87-4515-8533-39428b169683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:09.600957 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-206e29a4-9d87-4515-8533-39428b169683 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.114559 Nov 12 02:29:09.601603 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 277/580] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:09 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:09.609732 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1ba0bc42-dd1e-4e28-ab24-c424f274d199 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:09.610742 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1ba0bc42-dd1e-4e28-ab24-c424f274d199 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:09.619320 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1ba0bc42-dd1e-4e28-ab24-c424f274d199 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:09.619852 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1ba0bc42-dd1e-4e28-ab24-c424f274d199 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:09.620808 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1ba0bc42-dd1e-4e28-ab24-c424f274d199 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:09.621337 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1ba0bc42-dd1e-4e28-ab24-c424f274d199 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:09.719664 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1ba0bc42-dd1e-4e28-ab24-c424f274d199 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.113598 Nov 12 02:29:09.720226 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 304/581] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:09 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:10.613475 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1c73895f-f5a3-4c27-9c9a-0bf78698c060 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:10.614642 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1c73895f-f5a3-4c27-9c9a-0bf78698c060 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:10.622850 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c73895f-f5a3-4c27-9c9a-0bf78698c060 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:10.623310 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c73895f-f5a3-4c27-9c9a-0bf78698c060 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:10.624240 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c73895f-f5a3-4c27-9c9a-0bf78698c060 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:10.624720 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c73895f-f5a3-4c27-9c9a-0bf78698c060 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:10.734026 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-623c28fe-e305-4c6a-935a-1eb321517ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:10.735587 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-623c28fe-e305-4c6a-935a-1eb321517ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:10.745487 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-623c28fe-e305-4c6a-935a-1eb321517ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:10.746780 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-623c28fe-e305-4c6a-935a-1eb321517ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:10.747487 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-623c28fe-e305-4c6a-935a-1eb321517ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:10.748205 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-623c28fe-e305-4c6a-935a-1eb321517ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:10.748524 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1c73895f-f5a3-4c27-9c9a-0bf78698c060 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.139077 Nov 12 02:29:10.749592 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 278/582] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:10 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:10.868592 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-623c28fe-e305-4c6a-935a-1eb321517ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.140301 Nov 12 02:29:10.869499 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 305/583] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:10 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:11.761579 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2386e75b-5e35-4049-976b-a7996d0d07eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:11.762582 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2386e75b-5e35-4049-976b-a7996d0d07eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:11.769507 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2386e75b-5e35-4049-976b-a7996d0d07eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:11.769962 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2386e75b-5e35-4049-976b-a7996d0d07eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:11.770803 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2386e75b-5e35-4049-976b-a7996d0d07eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:11.771247 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2386e75b-5e35-4049-976b-a7996d0d07eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:11.881920 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-36042303-4e8f-463e-9cb3-e653a18ce959 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:11.883014 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-36042303-4e8f-463e-9cb3-e653a18ce959 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:11.890560 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-36042303-4e8f-463e-9cb3-e653a18ce959 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:11.891083 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-36042303-4e8f-463e-9cb3-e653a18ce959 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:11.892110 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-36042303-4e8f-463e-9cb3-e653a18ce959 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:11.892536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-36042303-4e8f-463e-9cb3-e653a18ce959 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:11.895171 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2386e75b-5e35-4049-976b-a7996d0d07eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.137573 Nov 12 02:29:11.896404 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 279/584] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:11 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:11.997255 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-36042303-4e8f-463e-9cb3-e653a18ce959 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.119730 Nov 12 02:29:11.998031 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 306/585] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:11 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:12.908299 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-76a85100-f4f3-4154-8207-916de9fd1df6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:12.909331 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-76a85100-f4f3-4154-8207-916de9fd1df6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:12.917114 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76a85100-f4f3-4154-8207-916de9fd1df6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:12.917572 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76a85100-f4f3-4154-8207-916de9fd1df6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:12.918355 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76a85100-f4f3-4154-8207-916de9fd1df6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:12.918821 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76a85100-f4f3-4154-8207-916de9fd1df6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:13.014278 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-639d5e61-afa2-42cc-851e-449cb71d605c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:13.016061 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-639d5e61-afa2-42cc-851e-449cb71d605c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:13.024296 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-639d5e61-afa2-42cc-851e-449cb71d605c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:13.024592 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-639d5e61-afa2-42cc-851e-449cb71d605c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:13.025743 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-639d5e61-afa2-42cc-851e-449cb71d605c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:13.026968 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-639d5e61-afa2-42cc-851e-449cb71d605c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:13.029730 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-76a85100-f4f3-4154-8207-916de9fd1df6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.125362 Nov 12 02:29:13.030618 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 280/586] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:12 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:13.149529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-639d5e61-afa2-42cc-851e-449cb71d605c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.142436 Nov 12 02:29:13.150285 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 307/587] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:13 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:14.043194 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5ef2c396-26ce-4f2c-9336-4e022861d3d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:14.044893 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5ef2c396-26ce-4f2c-9336-4e022861d3d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:14.052207 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ef2c396-26ce-4f2c-9336-4e022861d3d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:14.052684 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ef2c396-26ce-4f2c-9336-4e022861d3d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:14.053473 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ef2c396-26ce-4f2c-9336-4e022861d3d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:14.053955 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5ef2c396-26ce-4f2c-9336-4e022861d3d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:14.164925 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-bdc6cec3-14dc-43ac-b4ac-7a74e52ee773 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:14.166625 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5ef2c396-26ce-4f2c-9336-4e022861d3d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.127511 Nov 12 02:29:14.167286 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-bdc6cec3-14dc-43ac-b4ac-7a74e52ee773 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:14.172378 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 281/588] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:14 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:14.174873 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bdc6cec3-14dc-43ac-b4ac-7a74e52ee773 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:14.175331 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bdc6cec3-14dc-43ac-b4ac-7a74e52ee773 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:14.176217 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bdc6cec3-14dc-43ac-b4ac-7a74e52ee773 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:14.177196 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bdc6cec3-14dc-43ac-b4ac-7a74e52ee773 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:14.288343 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-bdc6cec3-14dc-43ac-b4ac-7a74e52ee773 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.127305 Nov 12 02:29:14.293191 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 308/589] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:14 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:14.419675 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-77eb0f5a-92ec-4c34-afb4-fe14ee793454 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:14.420689 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-77eb0f5a-92ec-4c34-afb4-fe14ee793454 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:14.427524 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-77eb0f5a-92ec-4c34-afb4-fe14ee793454 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:14.427966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-77eb0f5a-92ec-4c34-afb4-fe14ee793454 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:14.428751 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-77eb0f5a-92ec-4c34-afb4-fe14ee793454 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:14.429168 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-77eb0f5a-92ec-4c34-afb4-fe14ee793454 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:14.453113 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-77eb0f5a-92ec-4c34-afb4-fe14ee793454 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lazy-loading 'flavor' on Instance uuid 44c025f0-3bb5-4ce5-944f-0f553ef80f8a {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:29:14.581484 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-77eb0f5a-92ec-4c34-afb4-fe14ee793454 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "POST /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/action" status: 200 len: 32 microversion: 2.1 time: 0.168406 Nov 12 02:29:14.582099 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 282/590] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:14 2021] POST /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:29:14.596132 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a52bf971-a76e-4c49-b6f8-c98059dea0fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:14.597433 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a52bf971-a76e-4c49-b6f8-c98059dea0fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:14.610227 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a52bf971-a76e-4c49-b6f8-c98059dea0fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:14.611455 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a52bf971-a76e-4c49-b6f8-c98059dea0fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:14.613317 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a52bf971-a76e-4c49-b6f8-c98059dea0fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:14.614944 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a52bf971-a76e-4c49-b6f8-c98059dea0fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:14.789781 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a52bf971-a76e-4c49-b6f8-c98059dea0fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:14.797820 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a52bf971-a76e-4c49-b6f8-c98059dea0fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.209207 Nov 12 02:29:14.798420 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 309/591] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:14 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:15.181101 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a3c2ee86-6694-4244-a675-8d4858a930f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:15.182391 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a3c2ee86-6694-4244-a675-8d4858a930f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:15.189420 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a3c2ee86-6694-4244-a675-8d4858a930f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:15.189871 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a3c2ee86-6694-4244-a675-8d4858a930f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:15.190645 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a3c2ee86-6694-4244-a675-8d4858a930f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:15.191106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a3c2ee86-6694-4244-a675-8d4858a930f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:15.300765 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-55af4987-97ba-4085-b47d-b766c336a7ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:15.301832 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-55af4987-97ba-4085-b47d-b766c336a7ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:15.309756 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-55af4987-97ba-4085-b47d-b766c336a7ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:15.310243 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-55af4987-97ba-4085-b47d-b766c336a7ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:15.311099 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-55af4987-97ba-4085-b47d-b766c336a7ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:15.311566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-55af4987-97ba-4085-b47d-b766c336a7ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:15.406470 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a3c2ee86-6694-4244-a675-8d4858a930f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.230537 Nov 12 02:29:15.407658 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 283/592] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:15 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:15.461903 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-55af4987-97ba-4085-b47d-b766c336a7ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.163170 Nov 12 02:29:15.463024 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 310/593] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:15 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:15.822505 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-53155f8d-041c-4288-8a45-3f54e942bf54 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:15.823136 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-53155f8d-041c-4288-8a45-3f54e942bf54 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:15.830279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-53155f8d-041c-4288-8a45-3f54e942bf54 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:15.830759 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-53155f8d-041c-4288-8a45-3f54e942bf54 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:15.831545 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-53155f8d-041c-4288-8a45-3f54e942bf54 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:15.831972 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-53155f8d-041c-4288-8a45-3f54e942bf54 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:15.997651 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-53155f8d-041c-4288-8a45-3f54e942bf54 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:16.006806 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-53155f8d-041c-4288-8a45-3f54e942bf54 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.188595 Nov 12 02:29:16.007964 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 284/594] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:15 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:16.421192 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-717f3990-361b-42ec-a4a1-f900e97c9630 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:16.422215 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-717f3990-361b-42ec-a4a1-f900e97c9630 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:16.429522 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-717f3990-361b-42ec-a4a1-f900e97c9630 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:16.429968 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-717f3990-361b-42ec-a4a1-f900e97c9630 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:16.430802 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-717f3990-361b-42ec-a4a1-f900e97c9630 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:16.431240 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-717f3990-361b-42ec-a4a1-f900e97c9630 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:16.475243 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8c34533b-7872-4888-9d59-2d10a06477fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:16.476153 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8c34533b-7872-4888-9d59-2d10a06477fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:16.482430 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c34533b-7872-4888-9d59-2d10a06477fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:16.482908 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c34533b-7872-4888-9d59-2d10a06477fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:16.483713 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c34533b-7872-4888-9d59-2d10a06477fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:16.484137 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c34533b-7872-4888-9d59-2d10a06477fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:20.644781 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-717f3990-361b-42ec-a4a1-f900e97c9630 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 4.227607 Nov 12 02:29:20.646840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 311/595] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:16 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 4230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:20.650905 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-13e6aeec-a1ff-47df-aa44-df8260d56952 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:20.651597 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-13e6aeec-a1ff-47df-aa44-df8260d56952 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:20.659144 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-13e6aeec-a1ff-47df-aa44-df8260d56952 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:20.659593 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-13e6aeec-a1ff-47df-aa44-df8260d56952 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:20.660371 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-13e6aeec-a1ff-47df-aa44-df8260d56952 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:20.660808 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-13e6aeec-a1ff-47df-aa44-df8260d56952 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:20.710516 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8c34533b-7872-4888-9d59-2d10a06477fe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 4.239377 Nov 12 02:29:20.711280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 285/596] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:16 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 4241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:20.825596 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-13e6aeec-a1ff-47df-aa44-df8260d56952 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:20.836536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-13e6aeec-a1ff-47df-aa44-df8260d56952 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.189320 Nov 12 02:29:20.837622 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 312/597] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:20 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:21.658348 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ae27db59-3660-443f-a11a-d267aa61bd60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:21.659422 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ae27db59-3660-443f-a11a-d267aa61bd60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:21.667244 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ae27db59-3660-443f-a11a-d267aa61bd60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:21.667717 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ae27db59-3660-443f-a11a-d267aa61bd60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:21.668547 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ae27db59-3660-443f-a11a-d267aa61bd60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:21.669003 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ae27db59-3660-443f-a11a-d267aa61bd60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:21.722007 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8ae86f17-5856-4327-a593-c418cd54183c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:21.723027 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8ae86f17-5856-4327-a593-c418cd54183c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:21.730169 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8ae86f17-5856-4327-a593-c418cd54183c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:21.730622 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8ae86f17-5856-4327-a593-c418cd54183c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:21.731440 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8ae86f17-5856-4327-a593-c418cd54183c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:21.731879 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8ae86f17-5856-4327-a593-c418cd54183c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:21.846925 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ae27db59-3660-443f-a11a-d267aa61bd60 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.192463 Nov 12 02:29:21.847536 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 286/598] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:21 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:29:21.856676 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c4772795-5939-4e0b-9b0e-2e81ee175fe9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:21.857465 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c4772795-5939-4e0b-9b0e-2e81ee175fe9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:21.866313 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c4772795-5939-4e0b-9b0e-2e81ee175fe9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:21.867041 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c4772795-5939-4e0b-9b0e-2e81ee175fe9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:21.868219 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c4772795-5939-4e0b-9b0e-2e81ee175fe9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:21.868726 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c4772795-5939-4e0b-9b0e-2e81ee175fe9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:21.870528 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8ae86f17-5856-4327-a593-c418cd54183c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.152420 Nov 12 02:29:21.871236 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 313/599] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:21 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:22.026644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c4772795-5939-4e0b-9b0e-2e81ee175fe9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:22.038200 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c4772795-5939-4e0b-9b0e-2e81ee175fe9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.186059 Nov 12 02:29:22.049956 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 287/600] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:21 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:22.860235 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9272d1f8-e0d6-41f8-bc1d-ad1ac812f189 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:22.861267 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9272d1f8-e0d6-41f8-bc1d-ad1ac812f189 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:22.869527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9272d1f8-e0d6-41f8-bc1d-ad1ac812f189 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:22.870010 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9272d1f8-e0d6-41f8-bc1d-ad1ac812f189 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:22.870920 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9272d1f8-e0d6-41f8-bc1d-ad1ac812f189 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:22.871399 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9272d1f8-e0d6-41f8-bc1d-ad1ac812f189 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:22.882389 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-943caeb7-b976-4487-8390-9597e54fafc8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:22.883511 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-943caeb7-b976-4487-8390-9597e54fafc8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:22.889756 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-943caeb7-b976-4487-8390-9597e54fafc8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:22.890207 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-943caeb7-b976-4487-8390-9597e54fafc8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:22.891034 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-943caeb7-b976-4487-8390-9597e54fafc8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:22.891475 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-943caeb7-b976-4487-8390-9597e54fafc8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:23.017180 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9272d1f8-e0d6-41f8-bc1d-ad1ac812f189 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.158785 Nov 12 02:29:23.017180 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 314/601] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:22 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:29:23.037356 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-943caeb7-b976-4487-8390-9597e54fafc8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.157498 Nov 12 02:29:23.038182 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 288/602] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:22 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:23.058317 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-bdf709c9-df03-4aa6-a679-27ac72b31483 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:23.059150 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-bdf709c9-df03-4aa6-a679-27ac72b31483 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:23.066430 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bdf709c9-df03-4aa6-a679-27ac72b31483 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:23.066902 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bdf709c9-df03-4aa6-a679-27ac72b31483 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:23.067681 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bdf709c9-df03-4aa6-a679-27ac72b31483 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:23.068110 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bdf709c9-df03-4aa6-a679-27ac72b31483 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:23.205717 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-bdf709c9-df03-4aa6-a679-27ac72b31483 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:23.214248 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-bdf709c9-df03-4aa6-a679-27ac72b31483 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.160098 Nov 12 02:29:23.225164 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 315/603] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:23 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:23.288694 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-76e4d175-38bb-4cc4-8228-caa9b5dda037 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3f44ca5-f811-4896-81e9-67e8c97b504e"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:23.289937 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-76e4d175-38bb-4cc4-8228-caa9b5dda037 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:23.297054 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76e4d175-38bb-4cc4-8228-caa9b5dda037 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:23.297651 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76e4d175-38bb-4cc4-8228-caa9b5dda037 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:23.299135 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76e4d175-38bb-4cc4-8228-caa9b5dda037 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:23.299577 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76e4d175-38bb-4cc4-8228-caa9b5dda037 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:23.383622 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-76e4d175-38bb-4cc4-8228-caa9b5dda037 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] HTTP exception thrown: Invalid volume: volume d3f44ca5-f811-4896-81e9-67e8c97b504e is already attached to instances: 1199c966-c222-4f06-8d6c-80d247db4c5a Nov 12 02:29:23.384631 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-76e4d175-38bb-4cc4-8228-caa9b5dda037 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Returning 400 to user: Invalid volume: volume d3f44ca5-f811-4896-81e9-67e8c97b504e is already attached to instances: 1199c966-c222-4f06-8d6c-80d247db4c5a {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:29:23.385950 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-76e4d175-38bb-4cc4-8228-caa9b5dda037 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "POST /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101953 Nov 12 02:29:23.390144 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 289/604] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:29:23 2021] POST /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 12 02:29:23.454650 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-68b3e92d-20c5-4c05-93a2-28cd0a848d20 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:23.455148 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-68b3e92d-20c5-4c05-93a2-28cd0a848d20 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:23.462133 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-68b3e92d-20c5-4c05-93a2-28cd0a848d20 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:23.462583 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-68b3e92d-20c5-4c05-93a2-28cd0a848d20 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:23.463389 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-68b3e92d-20c5-4c05-93a2-28cd0a848d20 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:23.463826 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-68b3e92d-20c5-4c05-93a2-28cd0a848d20 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:23.591772 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-68b3e92d-20c5-4c05-93a2-28cd0a848d20 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lazy-loading 'services' on Instance uuid 1199c966-c222-4f06-8d6c-80d247db4c5a {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:29:23.709689 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-68b3e92d-20c5-4c05-93a2-28cd0a848d20 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a/os-volume_attachments/d3f44ca5-f811-4896-81e9-67e8c97b504e" status: 202 len: 0 microversion: 2.1 time: 0.258548 Nov 12 02:29:23.710650 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 316/605] 10.222.0.70 () {58 vars in 1415 bytes} [Fri Nov 12 02:29:23 2021] DELETE /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a/os-volume_attachments/d3f44ca5-f811-4896-81e9-67e8c97b504e => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:23.718937 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c3883220-3904-47bf-b3e2-966abb0fc7b9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:23.719990 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c3883220-3904-47bf-b3e2-966abb0fc7b9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:23.729477 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c3883220-3904-47bf-b3e2-966abb0fc7b9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:23.729920 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c3883220-3904-47bf-b3e2-966abb0fc7b9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:23.730950 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c3883220-3904-47bf-b3e2-966abb0fc7b9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:23.731391 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c3883220-3904-47bf-b3e2-966abb0fc7b9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:23.767869 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c3883220-3904-47bf-b3e2-966abb0fc7b9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052659 Nov 12 02:29:23.769357 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 290/606] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:29:23 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:29:24.029810 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-934e2ac4-5c8f-4f0d-aef6-f1b6502f5828 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:24.031022 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-934e2ac4-5c8f-4f0d-aef6-f1b6502f5828 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:24.039282 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-934e2ac4-5c8f-4f0d-aef6-f1b6502f5828 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:24.039809 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-934e2ac4-5c8f-4f0d-aef6-f1b6502f5828 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:24.040760 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-934e2ac4-5c8f-4f0d-aef6-f1b6502f5828 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:24.041268 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-934e2ac4-5c8f-4f0d-aef6-f1b6502f5828 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:24.049538 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1475921d-62ac-4b92-8e71-703b728d2246 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:24.050476 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1475921d-62ac-4b92-8e71-703b728d2246 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:24.057860 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1475921d-62ac-4b92-8e71-703b728d2246 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:24.058311 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1475921d-62ac-4b92-8e71-703b728d2246 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:24.059141 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1475921d-62ac-4b92-8e71-703b728d2246 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:24.059907 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1475921d-62ac-4b92-8e71-703b728d2246 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:24.228381 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-934e2ac4-5c8f-4f0d-aef6-f1b6502f5828 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.203914 Nov 12 02:29:24.229026 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 317/607] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:24 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:29:24.233764 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6bedc073-d500-40ce-8c91-35b9d643135e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:24.234444 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6bedc073-d500-40ce-8c91-35b9d643135e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:24.242149 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6bedc073-d500-40ce-8c91-35b9d643135e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:24.242889 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6bedc073-d500-40ce-8c91-35b9d643135e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:24.243660 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6bedc073-d500-40ce-8c91-35b9d643135e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:24.244094 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6bedc073-d500-40ce-8c91-35b9d643135e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:24.254208 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1475921d-62ac-4b92-8e71-703b728d2246 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.208043 Nov 12 02:29:24.259264 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 291/608] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:24 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:24.407720 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6bedc073-d500-40ce-8c91-35b9d643135e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:24.416421 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6bedc073-d500-40ce-8c91-35b9d643135e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.186267 Nov 12 02:29:24.417026 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 318/609] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:24 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:24.782922 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f7a0af5d-1e22-4c00-ade8-bf714ed7cf3a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:24.783989 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f7a0af5d-1e22-4c00-ade8-bf714ed7cf3a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:24.795059 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7a0af5d-1e22-4c00-ade8-bf714ed7cf3a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:24.796879 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7a0af5d-1e22-4c00-ade8-bf714ed7cf3a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:24.797772 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7a0af5d-1e22-4c00-ade8-bf714ed7cf3a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:24.798241 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7a0af5d-1e22-4c00-ade8-bf714ed7cf3a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:24.837498 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f7a0af5d-1e22-4c00-ade8-bf714ed7cf3a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059084 Nov 12 02:29:24.838085 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 292/610] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:29:24 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:29:25.241314 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d204baec-b1cc-44b0-b1b0-2d8aef9d285b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:25.242233 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d204baec-b1cc-44b0-b1b0-2d8aef9d285b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:25.248872 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d204baec-b1cc-44b0-b1b0-2d8aef9d285b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:25.249357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d204baec-b1cc-44b0-b1b0-2d8aef9d285b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:25.250131 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d204baec-b1cc-44b0-b1b0-2d8aef9d285b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:25.250570 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d204baec-b1cc-44b0-b1b0-2d8aef9d285b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:25.266989 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a11524fd-9130-43a4-99c6-5859dddf078f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:25.268035 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a11524fd-9130-43a4-99c6-5859dddf078f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:25.275651 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a11524fd-9130-43a4-99c6-5859dddf078f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:25.276105 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a11524fd-9130-43a4-99c6-5859dddf078f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:25.276896 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a11524fd-9130-43a4-99c6-5859dddf078f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:25.277333 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a11524fd-9130-43a4-99c6-5859dddf078f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:25.379096 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d204baec-b1cc-44b0-b1b0-2d8aef9d285b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.141458 Nov 12 02:29:25.380342 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 319/611] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:25 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:25.400150 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a11524fd-9130-43a4-99c6-5859dddf078f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.136409 Nov 12 02:29:25.404124 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 293/612] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:25 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:25.445150 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a5937363-6784-4220-93b7-61285a84a1bf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:25.446031 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a5937363-6784-4220-93b7-61285a84a1bf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:25.458715 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a5937363-6784-4220-93b7-61285a84a1bf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:25.459511 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a5937363-6784-4220-93b7-61285a84a1bf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:25.460853 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a5937363-6784-4220-93b7-61285a84a1bf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:25.461606 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a5937363-6784-4220-93b7-61285a84a1bf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:25.627032 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a5937363-6784-4220-93b7-61285a84a1bf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:25.635559 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a5937363-6784-4220-93b7-61285a84a1bf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.195471 Nov 12 02:29:25.636169 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 320/613] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:25 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:25.850279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4d917df2-970f-4019-a656-0e37fd718efb tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:25.851303 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4d917df2-970f-4019-a656-0e37fd718efb tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:25.858218 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d917df2-970f-4019-a656-0e37fd718efb tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:25.858685 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d917df2-970f-4019-a656-0e37fd718efb tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:25.859477 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d917df2-970f-4019-a656-0e37fd718efb tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:25.859920 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d917df2-970f-4019-a656-0e37fd718efb tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:25.891410 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4d917df2-970f-4019-a656-0e37fd718efb tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045348 Nov 12 02:29:25.891979 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 294/614] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:29:25 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:29:26.051078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-917709749", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "networks": [{"uuid": "4070c229-4da3-4ab6-91a8-6b9e74d5d318"}]}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:26.108274 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.network.neutron [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] validate_networks() for [('4070c229-4da3-4ab6-91a8-6b9e74d5d318', None, None, None, None, None)] {{(pid=116099) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:29:26.395754 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7e39faf1-0b39-4c4f-8761-a3fa38e7c529 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:26.397248 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7e39faf1-0b39-4c4f-8761-a3fa38e7c529 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:26.405917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7e39faf1-0b39-4c4f-8761-a3fa38e7c529 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:26.406535 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7e39faf1-0b39-4c4f-8761-a3fa38e7c529 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:26.407499 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7e39faf1-0b39-4c4f-8761-a3fa38e7c529 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:26.407961 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7e39faf1-0b39-4c4f-8761-a3fa38e7c529 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:26.533237 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7e39faf1-0b39-4c4f-8761-a3fa38e7c529 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.144064 Nov 12 02:29:26.533905 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 295/615] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:26 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:26.541975 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f2e15b5a-a8e7-4b9b-98f7-7ce8037026b1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:26.543590 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f2e15b5a-a8e7-4b9b-98f7-7ce8037026b1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:26.545938 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Flavor limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:29:26.546434 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Image limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:29:26.546986 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Flavor pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:29:26.547481 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Image pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:29:26.547954 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:29:26.553651 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2e15b5a-a8e7-4b9b-98f7-7ce8037026b1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:26.554160 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2e15b5a-a8e7-4b9b-98f7-7ce8037026b1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:26.555031 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2e15b5a-a8e7-4b9b-98f7-7ce8037026b1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:26.555490 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2e15b5a-a8e7-4b9b-98f7-7ce8037026b1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:26.558127 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:26.558716 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:26.559695 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:26.560262 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:26.580850 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Getting quotas for project bf1009072a7446b8a468d02d87b9420d. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:29:26.585977 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Getting quotas for user 8f90ce43dddc437fbd6d0531529c6456 and project bf1009072a7446b8a468d02d87b9420d. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:29:26.600369 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Going to run 1 instances... {{(pid=116099) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:29:26.603348 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:29:26.658416 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2eabf862-c418-4cc0-b7eb-154d3f6f427c tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610710 Nov 12 02:29:26.662486 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 321/616] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:29:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:29:26.665349 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-926fe828-433b-4e66-af22-3ff707ee0923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:26.665772 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f2e15b5a-a8e7-4b9b-98f7-7ce8037026b1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.129951 Nov 12 02:29:26.665936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-926fe828-433b-4e66-af22-3ff707ee0923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:26.666912 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 296/617] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:26 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:26.672980 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-926fe828-433b-4e66-af22-3ff707ee0923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:26.673554 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-926fe828-433b-4e66-af22-3ff707ee0923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:26.674933 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-926fe828-433b-4e66-af22-3ff707ee0923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:26.675058 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-26731d0b-d034-44d2-90d7-ed7cbd62542a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:26.675171 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-926fe828-433b-4e66-af22-3ff707ee0923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:26.687490 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-26731d0b-d034-44d2-90d7-ed7cbd62542a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:26.766271 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-26731d0b-d034-44d2-90d7-ed7cbd62542a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:26.773806 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-26731d0b-d034-44d2-90d7-ed7cbd62542a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1217 microversion: 2.1 time: 0.105321 Nov 12 02:29:26.775120 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 297/618] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:26 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:26.845251 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-926fe828-433b-4e66-af22-3ff707ee0923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:26.854924 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-926fe828-433b-4e66-af22-3ff707ee0923 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.194333 Nov 12 02:29:26.855501 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 322/619] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:26 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:27.546326 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f832e3ef-f2b5-4e72-813d-7c1266fd707e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:27.547224 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f832e3ef-f2b5-4e72-813d-7c1266fd707e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:27.554299 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f832e3ef-f2b5-4e72-813d-7c1266fd707e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:27.554774 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f832e3ef-f2b5-4e72-813d-7c1266fd707e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:27.555570 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f832e3ef-f2b5-4e72-813d-7c1266fd707e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:27.555992 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f832e3ef-f2b5-4e72-813d-7c1266fd707e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:27.661288 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f832e3ef-f2b5-4e72-813d-7c1266fd707e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.118602 Nov 12 02:29:27.662069 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 298/620] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:27 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:29:27.682245 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2258adcc-2ffa-4a96-bbf8-06163fa9dfdd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:27.683411 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2258adcc-2ffa-4a96-bbf8-06163fa9dfdd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:27.689878 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2258adcc-2ffa-4a96-bbf8-06163fa9dfdd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:27.691514 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2258adcc-2ffa-4a96-bbf8-06163fa9dfdd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:27.691514 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2258adcc-2ffa-4a96-bbf8-06163fa9dfdd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:27.691808 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2258adcc-2ffa-4a96-bbf8-06163fa9dfdd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:27.793766 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6d03df13-36d4-43b6-bb74-75db8ba6a014 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:27.794612 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6d03df13-36d4-43b6-bb74-75db8ba6a014 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:27.805966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d03df13-36d4-43b6-bb74-75db8ba6a014 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:27.806328 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d03df13-36d4-43b6-bb74-75db8ba6a014 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:27.807200 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d03df13-36d4-43b6-bb74-75db8ba6a014 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:27.807638 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d03df13-36d4-43b6-bb74-75db8ba6a014 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:27.836727 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2258adcc-2ffa-4a96-bbf8-06163fa9dfdd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.158528 Nov 12 02:29:27.838812 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 323/621] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:27 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:27.874206 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-627496c6-63bf-4546-b00e-b3786704f12f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:27.875252 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-627496c6-63bf-4546-b00e-b3786704f12f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:27.885271 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-627496c6-63bf-4546-b00e-b3786704f12f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:27.885842 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-627496c6-63bf-4546-b00e-b3786704f12f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:27.887157 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-627496c6-63bf-4546-b00e-b3786704f12f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:27.887673 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-627496c6-63bf-4546-b00e-b3786704f12f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:27.889292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6d03df13-36d4-43b6-bb74-75db8ba6a014 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:27.901881 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6d03df13-36d4-43b6-bb74-75db8ba6a014 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1269 microversion: 2.1 time: 0.111288 Nov 12 02:29:27.901881 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 299/622] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:27 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1269 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:28.070382 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-627496c6-63bf-4546-b00e-b3786704f12f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:28.078789 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-627496c6-63bf-4546-b00e-b3786704f12f tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.208729 Nov 12 02:29:28.079355 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 324/623] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:27 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:28.674437 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dd013f7d-0299-4611-9035-5b94efbb09eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:28.677051 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dd013f7d-0299-4611-9035-5b94efbb09eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:28.687614 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd013f7d-0299-4611-9035-5b94efbb09eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:28.688679 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd013f7d-0299-4611-9035-5b94efbb09eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:28.689832 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd013f7d-0299-4611-9035-5b94efbb09eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:28.690574 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd013f7d-0299-4611-9035-5b94efbb09eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:28.831014 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dd013f7d-0299-4611-9035-5b94efbb09eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.160440 Nov 12 02:29:28.833347 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 300/624] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:28 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:28.852173 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-613949bc-305e-446b-a223-2245b93efec6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:28.853301 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-613949bc-305e-446b-a223-2245b93efec6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:28.860034 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-613949bc-305e-446b-a223-2245b93efec6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:28.860387 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-613949bc-305e-446b-a223-2245b93efec6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:28.861221 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-613949bc-305e-446b-a223-2245b93efec6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:28.861612 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-613949bc-305e-446b-a223-2245b93efec6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:28.923560 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8c6a74af-6edf-4372-8325-bc0a9290e7f4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:28.924476 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8c6a74af-6edf-4372-8325-bc0a9290e7f4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:28.937949 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c6a74af-6edf-4372-8325-bc0a9290e7f4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:28.939027 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c6a74af-6edf-4372-8325-bc0a9290e7f4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:28.940091 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c6a74af-6edf-4372-8325-bc0a9290e7f4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:28.940917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8c6a74af-6edf-4372-8325-bc0a9290e7f4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:28.982705 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-613949bc-305e-446b-a223-2245b93efec6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.135959 Nov 12 02:29:28.984071 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 325/625] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:28 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:29.096577 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e20bae18-a769-4563-be95-a2d4ecf4dec6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:29.097317 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e20bae18-a769-4563-be95-a2d4ecf4dec6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:29.105579 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e20bae18-a769-4563-be95-a2d4ecf4dec6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:29.106538 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e20bae18-a769-4563-be95-a2d4ecf4dec6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:29.107831 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e20bae18-a769-4563-be95-a2d4ecf4dec6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:29.108502 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e20bae18-a769-4563-be95-a2d4ecf4dec6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:29.115616 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8c6a74af-6edf-4372-8325-bc0a9290e7f4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:29.124369 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8c6a74af-6edf-4372-8325-bc0a9290e7f4 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1317 microversion: 2.1 time: 0.206509 Nov 12 02:29:29.124951 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 301/626] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:28 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:29.290153 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e20bae18-a769-4563-be95-a2d4ecf4dec6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:29.299158 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e20bae18-a769-4563-be95-a2d4ecf4dec6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.206709 Nov 12 02:29:29.299729 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 326/627] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:29 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:29.354451 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-16242d31-e565-4d4f-9ba8-661dc21bae2b req-f91d15ca-2e6b-467a-a13e-6569624b32a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f77f715d-8c97-4b1e-97e6-bc2113bcfdda", "tag": "7f000e01-26cd-44b1-8553-819556797aa2"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:29.357392 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:29:29.357392 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:29:29.376958 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-16242d31-e565-4d4f-9ba8-661dc21bae2b req-f91d15ca-2e6b-467a-a13e-6569624b32a2 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:29.378440 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-16242d31-e565-4d4f-9ba8-661dc21bae2b req-f91d15ca-2e6b-467a-a13e-6569624b32a2 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:29.392295 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-16242d31-e565-4d4f-9ba8-661dc21bae2b req-f91d15ca-2e6b-467a-a13e-6569624b32a2 service nova] Creating event network-changed:7f000e01-26cd-44b1-8553-819556797aa2 for instance f77f715d-8c97-4b1e-97e6-bc2113bcfdda on hv-cinder-80857 Nov 12 02:29:29.397811 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-16242d31-e565-4d4f-9ba8-661dc21bae2b req-f91d15ca-2e6b-467a-a13e-6569624b32a2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048444 Nov 12 02:29:29.398414 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 302/628] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:29:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:29:29.848022 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f5062059-9418-41ff-b6bf-ce64836447a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:29.849655 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f5062059-9418-41ff-b6bf-ce64836447a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:29.858905 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f5062059-9418-41ff-b6bf-ce64836447a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:29.859568 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f5062059-9418-41ff-b6bf-ce64836447a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:29.860190 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f5062059-9418-41ff-b6bf-ce64836447a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:29.860671 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f5062059-9418-41ff-b6bf-ce64836447a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:29.996256 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5bd625db-76ed-4e53-9f57-29404cf37d05 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:29.997197 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5bd625db-76ed-4e53-9f57-29404cf37d05 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:30.004728 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5bd625db-76ed-4e53-9f57-29404cf37d05 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:30.005181 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5bd625db-76ed-4e53-9f57-29404cf37d05 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:30.005973 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5bd625db-76ed-4e53-9f57-29404cf37d05 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:30.006420 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5bd625db-76ed-4e53-9f57-29404cf37d05 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:30.054262 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f5062059-9418-41ff-b6bf-ce64836447a3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.213310 Nov 12 02:29:30.054971 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 327/629] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:29 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:30.142118 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f6b0d50b-aab1-4981-9139-622d82dc1ee9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:30.143319 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f6b0d50b-aab1-4981-9139-622d82dc1ee9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:30.153596 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f6b0d50b-aab1-4981-9139-622d82dc1ee9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:30.153596 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f6b0d50b-aab1-4981-9139-622d82dc1ee9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:30.153596 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f6b0d50b-aab1-4981-9139-622d82dc1ee9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:30.153596 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f6b0d50b-aab1-4981-9139-622d82dc1ee9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:30.313179 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f6b0d50b-aab1-4981-9139-622d82dc1ee9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:30.321319 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f6b0d50b-aab1-4981-9139-622d82dc1ee9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1317 microversion: 2.1 time: 0.183227 Nov 12 02:29:30.321893 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 328/630] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:30 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:30.326293 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d4e185f3-1263-4c92-ac6d-d08508ce2de0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:30.326936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d4e185f3-1263-4c92-ac6d-d08508ce2de0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:30.333960 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d4e185f3-1263-4c92-ac6d-d08508ce2de0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:30.334437 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d4e185f3-1263-4c92-ac6d-d08508ce2de0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:30.335630 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d4e185f3-1263-4c92-ac6d-d08508ce2de0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:30.336375 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d4e185f3-1263-4c92-ac6d-d08508ce2de0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:30.489281 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d4e185f3-1263-4c92-ac6d-d08508ce2de0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:30.499252 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d4e185f3-1263-4c92-ac6d-d08508ce2de0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.176344 Nov 12 02:29:30.499835 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 329/631] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:30 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:30.540885 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5bd625db-76ed-4e53-9f57-29404cf37d05 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.549217 Nov 12 02:29:30.542521 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 303/632] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:29 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:31.068132 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a286398e-21ef-4d16-8745-679dc0e5f1da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:31.069065 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a286398e-21ef-4d16-8745-679dc0e5f1da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:31.076081 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a286398e-21ef-4d16-8745-679dc0e5f1da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:31.076607 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a286398e-21ef-4d16-8745-679dc0e5f1da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:31.077494 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a286398e-21ef-4d16-8745-679dc0e5f1da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:31.077928 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a286398e-21ef-4d16-8745-679dc0e5f1da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:31.342547 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8d59c3b7-2342-4525-8b8b-e439aa491405 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:31.343197 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8d59c3b7-2342-4525-8b8b-e439aa491405 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:31.351671 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8d59c3b7-2342-4525-8b8b-e439aa491405 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:31.352176 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8d59c3b7-2342-4525-8b8b-e439aa491405 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:31.352904 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8d59c3b7-2342-4525-8b8b-e439aa491405 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:31.353339 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8d59c3b7-2342-4525-8b8b-e439aa491405 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:31.433827 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a286398e-21ef-4d16-8745-679dc0e5f1da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.369506 Nov 12 02:29:31.434493 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 330/633] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:31 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:31.497186 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8d59c3b7-2342-4525-8b8b-e439aa491405 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:31.504639 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8d59c3b7-2342-4525-8b8b-e439aa491405 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1317 microversion: 2.1 time: 0.166862 Nov 12 02:29:31.505185 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 304/634] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:31 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:31.517514 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-105b4746-3723-43c1-8e8e-87b006b27628 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:31.518212 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-105b4746-3723-43c1-8e8e-87b006b27628 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:31.525776 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-105b4746-3723-43c1-8e8e-87b006b27628 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:31.526224 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-105b4746-3723-43c1-8e8e-87b006b27628 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:31.527036 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-105b4746-3723-43c1-8e8e-87b006b27628 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:31.527471 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-105b4746-3723-43c1-8e8e-87b006b27628 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:31.554137 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-19615a47-8d6f-4b38-9d1f-4eb092049912 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:31.555265 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-19615a47-8d6f-4b38-9d1f-4eb092049912 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:31.561408 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-19615a47-8d6f-4b38-9d1f-4eb092049912 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:31.561862 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-19615a47-8d6f-4b38-9d1f-4eb092049912 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:31.562657 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-19615a47-8d6f-4b38-9d1f-4eb092049912 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:31.563128 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-19615a47-8d6f-4b38-9d1f-4eb092049912 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:31.680963 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-19615a47-8d6f-4b38-9d1f-4eb092049912 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.130331 Nov 12 02:29:31.681981 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 305/635] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:31 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:31.696985 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-105b4746-3723-43c1-8e8e-87b006b27628 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:31.704725 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-105b4746-3723-43c1-8e8e-87b006b27628 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.191323 Nov 12 02:29:31.705276 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 331/636] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:31 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:32.447118 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e552c2bf-6e11-44a0-b7ab-9e8bbf20a95a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:32.448141 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e552c2bf-6e11-44a0-b7ab-9e8bbf20a95a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:32.455450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e552c2bf-6e11-44a0-b7ab-9e8bbf20a95a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:32.455937 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e552c2bf-6e11-44a0-b7ab-9e8bbf20a95a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:32.456760 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e552c2bf-6e11-44a0-b7ab-9e8bbf20a95a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:32.457279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e552c2bf-6e11-44a0-b7ab-9e8bbf20a95a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:32.521506 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-87b196c3-629f-4f95-9a4c-0e1265a0c5b0 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:32.522139 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-87b196c3-629f-4f95-9a4c-0e1265a0c5b0 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:32.528765 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-87b196c3-629f-4f95-9a4c-0e1265a0c5b0 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:32.529234 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-87b196c3-629f-4f95-9a4c-0e1265a0c5b0 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:32.530075 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-87b196c3-629f-4f95-9a4c-0e1265a0c5b0 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:32.530531 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-87b196c3-629f-4f95-9a4c-0e1265a0c5b0 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:32.560053 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e552c2bf-6e11-44a0-b7ab-9e8bbf20a95a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.117790 Nov 12 02:29:32.560702 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 306/637] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:32 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:32.689440 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-87b196c3-629f-4f95-9a4c-0e1265a0c5b0 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:32.693516 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-21dba833-914b-4bd8-b224-af1472123117 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:32.694510 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-21dba833-914b-4bd8-b224-af1472123117 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:32.696974 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-87b196c3-629f-4f95-9a4c-0e1265a0c5b0 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1317 microversion: 2.1 time: 0.179342 Nov 12 02:29:32.697725 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 332/638] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:32 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:32.702774 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-21dba833-914b-4bd8-b224-af1472123117 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:32.703226 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-21dba833-914b-4bd8-b224-af1472123117 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:32.704010 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-21dba833-914b-4bd8-b224-af1472123117 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:32.704442 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-21dba833-914b-4bd8-b224-af1472123117 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:32.722411 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-bd0cf05c-b82a-4781-98cd-a505a23c9ef8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:32.723546 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-bd0cf05c-b82a-4781-98cd-a505a23c9ef8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:32.729480 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bd0cf05c-b82a-4781-98cd-a505a23c9ef8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:32.729924 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bd0cf05c-b82a-4781-98cd-a505a23c9ef8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:32.730730 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bd0cf05c-b82a-4781-98cd-a505a23c9ef8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:32.731164 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bd0cf05c-b82a-4781-98cd-a505a23c9ef8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:32.815474 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-21dba833-914b-4bd8-b224-af1472123117 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.125983 Nov 12 02:29:32.816113 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 307/639] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:32 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:32.871070 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-bd0cf05c-b82a-4781-98cd-a505a23c9ef8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:32.879098 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-bd0cf05c-b82a-4781-98cd-a505a23c9ef8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.160204 Nov 12 02:29:32.879678 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 333/640] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:32 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:33.573268 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1c9fe9d2-7e91-4219-8a20-2053f2d64522 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:33.574190 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1c9fe9d2-7e91-4219-8a20-2053f2d64522 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:33.581237 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c9fe9d2-7e91-4219-8a20-2053f2d64522 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:33.581690 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c9fe9d2-7e91-4219-8a20-2053f2d64522 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:33.583213 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c9fe9d2-7e91-4219-8a20-2053f2d64522 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:33.583996 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1c9fe9d2-7e91-4219-8a20-2053f2d64522 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:33.678063 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1c9fe9d2-7e91-4219-8a20-2053f2d64522 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.108844 Nov 12 02:29:33.679750 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 308/641] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:33 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:33.713428 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3ea3f85f-8931-4909-ad1d-f0eec77e806e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:33.714010 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3ea3f85f-8931-4909-ad1d-f0eec77e806e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:33.720353 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ea3f85f-8931-4909-ad1d-f0eec77e806e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:33.720792 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ea3f85f-8931-4909-ad1d-f0eec77e806e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:33.721570 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ea3f85f-8931-4909-ad1d-f0eec77e806e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:33.722000 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ea3f85f-8931-4909-ad1d-f0eec77e806e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:33.831542 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-319c6955-3e8d-468a-8b2c-5697e6e38455 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:33.832640 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-319c6955-3e8d-468a-8b2c-5697e6e38455 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:33.839976 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-319c6955-3e8d-468a-8b2c-5697e6e38455 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:33.840441 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-319c6955-3e8d-468a-8b2c-5697e6e38455 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:33.841313 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-319c6955-3e8d-468a-8b2c-5697e6e38455 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:33.841779 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-319c6955-3e8d-468a-8b2c-5697e6e38455 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:33.862550 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3ea3f85f-8931-4909-ad1d-f0eec77e806e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:33.871037 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3ea3f85f-8931-4909-ad1d-f0eec77e806e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1317 microversion: 2.1 time: 0.161412 Nov 12 02:29:33.871621 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 334/642] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:33 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:33.895823 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ecab947d-a198-4ef5-8b62-212a46b9c34b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:33.896518 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ecab947d-a198-4ef5-8b62-212a46b9c34b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:33.902487 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ecab947d-a198-4ef5-8b62-212a46b9c34b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:33.902967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ecab947d-a198-4ef5-8b62-212a46b9c34b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:33.903750 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ecab947d-a198-4ef5-8b62-212a46b9c34b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:33.904188 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ecab947d-a198-4ef5-8b62-212a46b9c34b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:33.945128 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-319c6955-3e8d-468a-8b2c-5697e6e38455 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.120463 Nov 12 02:29:33.946007 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 309/643] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:33 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:34.050505 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ecab947d-a198-4ef5-8b62-212a46b9c34b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:34.059116 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ecab947d-a198-4ef5-8b62-212a46b9c34b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.166887 Nov 12 02:29:34.059695 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 335/644] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:33 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:34.386596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:29:34.386853 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: Fri Nov 12 02:29:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:29:34.691182 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-20655224-54e7-49b5-9249-f5b284dc888d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:34.692805 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-20655224-54e7-49b5-9249-f5b284dc888d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:34.699954 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20655224-54e7-49b5-9249-f5b284dc888d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:34.700396 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20655224-54e7-49b5-9249-f5b284dc888d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:34.701187 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20655224-54e7-49b5-9249-f5b284dc888d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:34.701625 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20655224-54e7-49b5-9249-f5b284dc888d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:34.835043 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-20655224-54e7-49b5-9249-f5b284dc888d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.147767 Nov 12 02:29:34.839048 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 310/645] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:34 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:34.888513 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-285203d1-d853-4b5e-b918-3d23c8176b89 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:34.889191 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-285203d1-d853-4b5e-b918-3d23c8176b89 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:34.896961 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-285203d1-d853-4b5e-b918-3d23c8176b89 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:34.897341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-285203d1-d853-4b5e-b918-3d23c8176b89 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:34.898120 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-285203d1-d853-4b5e-b918-3d23c8176b89 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:34.898547 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-285203d1-d853-4b5e-b918-3d23c8176b89 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:34.958758 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c9de27cc-0154-442f-982c-6b32d3fb7c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:34.959852 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c9de27cc-0154-442f-982c-6b32d3fb7c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:34.967345 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9de27cc-0154-442f-982c-6b32d3fb7c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:34.967821 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9de27cc-0154-442f-982c-6b32d3fb7c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:34.968608 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9de27cc-0154-442f-982c-6b32d3fb7c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:34.969035 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c9de27cc-0154-442f-982c-6b32d3fb7c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:35.053886 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-285203d1-d853-4b5e-b918-3d23c8176b89 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:35.061358 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-285203d1-d853-4b5e-b918-3d23c8176b89 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1317 microversion: 2.1 time: 0.176510 Nov 12 02:29:35.061935 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 336/646] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:34 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:35.075875 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-36322973-9191-475a-8e7d-ade5171187f0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:35.076316 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c9de27cc-0154-442f-982c-6b32d3fb7c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.122066 Nov 12 02:29:35.076495 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-36322973-9191-475a-8e7d-ade5171187f0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:35.077990 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 311/647] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:34 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:35.084334 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-36322973-9191-475a-8e7d-ade5171187f0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:35.084832 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-36322973-9191-475a-8e7d-ade5171187f0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:35.085661 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-36322973-9191-475a-8e7d-ade5171187f0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:35.086097 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-36322973-9191-475a-8e7d-ade5171187f0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:35.231259 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-36322973-9191-475a-8e7d-ade5171187f0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:35.239833 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-36322973-9191-475a-8e7d-ade5171187f0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.167554 Nov 12 02:29:35.240411 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 337/648] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:35 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:35.847396 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-36d63439-6dab-47fa-a055-005d40b5a89c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:35.848343 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-36d63439-6dab-47fa-a055-005d40b5a89c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:35.855844 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36d63439-6dab-47fa-a055-005d40b5a89c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:35.856303 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36d63439-6dab-47fa-a055-005d40b5a89c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:35.857712 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36d63439-6dab-47fa-a055-005d40b5a89c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:35.857712 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36d63439-6dab-47fa-a055-005d40b5a89c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:35.955947 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-36d63439-6dab-47fa-a055-005d40b5a89c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.112595 Nov 12 02:29:35.956920 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 312/649] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:35 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:36.079928 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-71430b21-a662-4102-b18a-c1ecba9beb2f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:36.080602 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-71430b21-a662-4102-b18a-c1ecba9beb2f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:36.087134 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-71430b21-a662-4102-b18a-c1ecba9beb2f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:36.087578 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-71430b21-a662-4102-b18a-c1ecba9beb2f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:36.088359 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-71430b21-a662-4102-b18a-c1ecba9beb2f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:36.088796 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-71430b21-a662-4102-b18a-c1ecba9beb2f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:36.090098 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d403f3a6-cfd1-42fe-a34b-44c19fa91310 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:36.091149 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d403f3a6-cfd1-42fe-a34b-44c19fa91310 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:36.098234 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d403f3a6-cfd1-42fe-a34b-44c19fa91310 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:36.098584 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d403f3a6-cfd1-42fe-a34b-44c19fa91310 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:36.099423 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d403f3a6-cfd1-42fe-a34b-44c19fa91310 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:36.099857 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d403f3a6-cfd1-42fe-a34b-44c19fa91310 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:36.196969 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d403f3a6-cfd1-42fe-a34b-44c19fa91310 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.110780 Nov 12 02:29:36.201824 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 313/650] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:36 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:36.240223 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-71430b21-a662-4102-b18a-c1ecba9beb2f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:36.248318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-71430b21-a662-4102-b18a-c1ecba9beb2f tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1317 microversion: 2.1 time: 0.172039 Nov 12 02:29:36.248900 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 338/651] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:36 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:36.257529 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dde8fcaa-2459-4746-bce3-204c0c3d808c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:36.258223 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dde8fcaa-2459-4746-bce3-204c0c3d808c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:36.265222 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dde8fcaa-2459-4746-bce3-204c0c3d808c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:36.265671 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dde8fcaa-2459-4746-bce3-204c0c3d808c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:36.266456 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dde8fcaa-2459-4746-bce3-204c0c3d808c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:36.266923 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dde8fcaa-2459-4746-bce3-204c0c3d808c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:36.420996 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dde8fcaa-2459-4746-bce3-204c0c3d808c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:36.429402 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dde8fcaa-2459-4746-bce3-204c0c3d808c tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.175983 Nov 12 02:29:36.429982 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 314/652] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:36 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:36.967908 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-14b819fd-7177-406a-a320-8e168a13eeee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:36.968827 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-14b819fd-7177-406a-a320-8e168a13eeee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:36.974812 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-14b819fd-7177-406a-a320-8e168a13eeee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:36.975336 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-14b819fd-7177-406a-a320-8e168a13eeee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:36.976232 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-14b819fd-7177-406a-a320-8e168a13eeee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:36.976723 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-14b819fd-7177-406a-a320-8e168a13eeee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:37.095656 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-14b819fd-7177-406a-a320-8e168a13eeee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.131274 Nov 12 02:29:37.096357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 339/653] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:36 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:29:37.210267 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6f1d51c3-ce92-49f3-a449-dc8499875d47 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:37.211280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6f1d51c3-ce92-49f3-a449-dc8499875d47 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:37.218042 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f1d51c3-ce92-49f3-a449-dc8499875d47 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:37.218412 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f1d51c3-ce92-49f3-a449-dc8499875d47 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:37.219210 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f1d51c3-ce92-49f3-a449-dc8499875d47 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:37.219640 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f1d51c3-ce92-49f3-a449-dc8499875d47 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:37.265822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8c1ad06a-c064-4307-b9ef-8cf0cb3a0d92 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:37.266503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8c1ad06a-c064-4307-b9ef-8cf0cb3a0d92 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:37.273474 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8c1ad06a-c064-4307-b9ef-8cf0cb3a0d92 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:37.273910 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8c1ad06a-c064-4307-b9ef-8cf0cb3a0d92 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:37.274716 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8c1ad06a-c064-4307-b9ef-8cf0cb3a0d92 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:37.275153 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8c1ad06a-c064-4307-b9ef-8cf0cb3a0d92 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:37.315248 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6f1d51c3-ce92-49f3-a449-dc8499875d47 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.109167 Nov 12 02:29:37.315925 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 315/654] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:37 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:37.417756 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8c1ad06a-c064-4307-b9ef-8cf0cb3a0d92 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:37.425207 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8c1ad06a-c064-4307-b9ef-8cf0cb3a0d92 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1317 microversion: 2.1 time: 0.163288 Nov 12 02:29:37.425779 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 340/655] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:37 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:37.446371 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f3bb3be8-8b76-42fd-b765-5172881cd8a6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:37.447214 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f3bb3be8-8b76-42fd-b765-5172881cd8a6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:37.454340 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f3bb3be8-8b76-42fd-b765-5172881cd8a6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:37.454831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f3bb3be8-8b76-42fd-b765-5172881cd8a6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:37.455632 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f3bb3be8-8b76-42fd-b765-5172881cd8a6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:37.456081 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f3bb3be8-8b76-42fd-b765-5172881cd8a6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:37.599769 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f3bb3be8-8b76-42fd-b765-5172881cd8a6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:37.607883 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f3bb3be8-8b76-42fd-b765-5172881cd8a6 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.165501 Nov 12 02:29:37.608457 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 316/656] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:37 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:38.107272 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-114cf059-9cd3-4059-8aad-721829360db2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:38.108185 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-114cf059-9cd3-4059-8aad-721829360db2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:38.115033 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-114cf059-9cd3-4059-8aad-721829360db2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:38.115479 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-114cf059-9cd3-4059-8aad-721829360db2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:38.116253 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-114cf059-9cd3-4059-8aad-721829360db2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:38.116686 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-114cf059-9cd3-4059-8aad-721829360db2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:38.220186 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-114cf059-9cd3-4059-8aad-721829360db2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.116355 Nov 12 02:29:38.220869 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 341/657] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:38 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:38.329917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e0594de7-0443-417d-9db8-7112282e2442 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:38.330882 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e0594de7-0443-417d-9db8-7112282e2442 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:38.337943 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e0594de7-0443-417d-9db8-7112282e2442 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:38.338396 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e0594de7-0443-417d-9db8-7112282e2442 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:38.339237 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e0594de7-0443-417d-9db8-7112282e2442 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:38.339680 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e0594de7-0443-417d-9db8-7112282e2442 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:38.438424 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e0594de7-0443-417d-9db8-7112282e2442 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.112271 Nov 12 02:29:38.439427 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 317/658] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:38 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:38.441844 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0c9d2202-7559-4df8-a386-fc9da8fa7ab9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:38.443276 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0c9d2202-7559-4df8-a386-fc9da8fa7ab9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:38.450166 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0c9d2202-7559-4df8-a386-fc9da8fa7ab9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:38.450611 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0c9d2202-7559-4df8-a386-fc9da8fa7ab9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:38.451417 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0c9d2202-7559-4df8-a386-fc9da8fa7ab9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:38.451852 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0c9d2202-7559-4df8-a386-fc9da8fa7ab9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:38.594140 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0c9d2202-7559-4df8-a386-fc9da8fa7ab9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:38.602444 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0c9d2202-7559-4df8-a386-fc9da8fa7ab9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1317 microversion: 2.1 time: 0.164682 Nov 12 02:29:38.603068 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 342/659] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:38 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:38.625316 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4d8f6c71-70fa-4259-b785-a4bbbbfad4b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:38.626041 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4d8f6c71-70fa-4259-b785-a4bbbbfad4b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:38.633098 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d8f6c71-70fa-4259-b785-a4bbbbfad4b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:38.633554 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d8f6c71-70fa-4259-b785-a4bbbbfad4b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:38.634373 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d8f6c71-70fa-4259-b785-a4bbbbfad4b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:38.634837 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d8f6c71-70fa-4259-b785-a4bbbbfad4b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:38.782384 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4d8f6c71-70fa-4259-b785-a4bbbbfad4b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:38.792159 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4d8f6c71-70fa-4259-b785-a4bbbbfad4b4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.170846 Nov 12 02:29:38.792745 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 318/660] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:38 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:38.879090 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-5b33de90-ad97-4d34-81b4-3764b25c2cfb req-3369ce5c-0088-46d1-997b-c27b3533a938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77f715d-8c97-4b1e-97e6-bc2113bcfdda", "name": "network-vif-plugged", "status": "completed", "tag": "7f000e01-26cd-44b1-8553-819556797aa2"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:38.880851 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:29:38.880851 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:29:38.889048 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-5b33de90-ad97-4d34-81b4-3764b25c2cfb req-3369ce5c-0088-46d1-997b-c27b3533a938 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:38.889670 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-5b33de90-ad97-4d34-81b4-3764b25c2cfb req-3369ce5c-0088-46d1-997b-c27b3533a938 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:38.901889 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-5b33de90-ad97-4d34-81b4-3764b25c2cfb req-3369ce5c-0088-46d1-997b-c27b3533a938 service nova] Creating event network-vif-plugged:7f000e01-26cd-44b1-8553-819556797aa2 for instance f77f715d-8c97-4b1e-97e6-bc2113bcfdda on hv-cinder-80857 Nov 12 02:29:38.906818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-5b33de90-ad97-4d34-81b4-3764b25c2cfb req-3369ce5c-0088-46d1-997b-c27b3533a938 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032303 Nov 12 02:29:38.907603 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 343/661] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:29:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:29:39.232620 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b9b40daf-de7e-4dbd-b4fb-24bd941dfb16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:39.233431 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b9b40daf-de7e-4dbd-b4fb-24bd941dfb16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:39.240395 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9b40daf-de7e-4dbd-b4fb-24bd941dfb16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:39.240976 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9b40daf-de7e-4dbd-b4fb-24bd941dfb16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:39.241853 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9b40daf-de7e-4dbd-b4fb-24bd941dfb16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:39.242286 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9b40daf-de7e-4dbd-b4fb-24bd941dfb16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:39.452003 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ce94b629-30c8-4ba7-a7df-7e3ae0e4c039 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:39.452985 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ce94b629-30c8-4ba7-a7df-7e3ae0e4c039 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:39.459119 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ce94b629-30c8-4ba7-a7df-7e3ae0e4c039 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:39.459557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ce94b629-30c8-4ba7-a7df-7e3ae0e4c039 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:39.460330 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ce94b629-30c8-4ba7-a7df-7e3ae0e4c039 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:39.460762 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ce94b629-30c8-4ba7-a7df-7e3ae0e4c039 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:39.703142 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ce94b629-30c8-4ba7-a7df-7e3ae0e4c039 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.255371 Nov 12 02:29:39.704529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 344/662] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:39 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:39.708716 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7120eed4-be8f-4913-9c42-3f2f3a12c770 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:39.709407 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7120eed4-be8f-4913-9c42-3f2f3a12c770 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:39.716374 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7120eed4-be8f-4913-9c42-3f2f3a12c770 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:39.716821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7120eed4-be8f-4913-9c42-3f2f3a12c770 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:39.717606 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7120eed4-be8f-4913-9c42-3f2f3a12c770 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:39.718039 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7120eed4-be8f-4913-9c42-3f2f3a12c770 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:39.740518 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b9b40daf-de7e-4dbd-b4fb-24bd941dfb16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 28597 microversion: 2.20 time: 0.511494 Nov 12 02:29:39.744778 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 319/663] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:39 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 28597 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:39.812079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-56b78038-af0d-4af6-8294-f8de182c5b52 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:39.813025 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-56b78038-af0d-4af6-8294-f8de182c5b52 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:39.821135 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-56b78038-af0d-4af6-8294-f8de182c5b52 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:39.821712 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-56b78038-af0d-4af6-8294-f8de182c5b52 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:39.822604 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-56b78038-af0d-4af6-8294-f8de182c5b52 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:39.823209 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-56b78038-af0d-4af6-8294-f8de182c5b52 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:39.859030 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7120eed4-be8f-4913-9c42-3f2f3a12c770 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:39.867762 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7120eed4-be8f-4913-9c42-3f2f3a12c770 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1317 microversion: 2.1 time: 0.162509 Nov 12 02:29:39.868346 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 345/664] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:39 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:39.968429 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-56b78038-af0d-4af6-8294-f8de182c5b52 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:39.980919 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-56b78038-af0d-4af6-8294-f8de182c5b52 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.172974 Nov 12 02:29:39.981792 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 320/665] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:39 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:40.631099 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:29:40.631672 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: Fri Nov 12 02:29:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:29:40.714901 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e2434b48-0951-451b-8711-f6ef2599b200 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:40.715839 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e2434b48-0951-451b-8711-f6ef2599b200 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:40.723873 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e2434b48-0951-451b-8711-f6ef2599b200 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:40.724316 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e2434b48-0951-451b-8711-f6ef2599b200 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:40.725143 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e2434b48-0951-451b-8711-f6ef2599b200 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:40.725566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e2434b48-0951-451b-8711-f6ef2599b200 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:40.752355 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7737f4f5-5bac-4e77-b477-bdd122e6fe49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:40.753267 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7737f4f5-5bac-4e77-b477-bdd122e6fe49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:40.760855 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7737f4f5-5bac-4e77-b477-bdd122e6fe49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:40.761299 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7737f4f5-5bac-4e77-b477-bdd122e6fe49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:40.762086 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7737f4f5-5bac-4e77-b477-bdd122e6fe49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:40.762523 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7737f4f5-5bac-4e77-b477-bdd122e6fe49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:40.902584 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7737f4f5-5bac-4e77-b477-bdd122e6fe49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 29331 microversion: 2.20 time: 0.153584 Nov 12 02:29:40.903178 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 321/666] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:40 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 29331 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:29:40.907937 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e52c908c-25bb-482d-9c0a-08cd8a911460 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:40.908653 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e52c908c-25bb-482d-9c0a-08cd8a911460 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:40.916689 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e52c908c-25bb-482d-9c0a-08cd8a911460 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:40.917136 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e52c908c-25bb-482d-9c0a-08cd8a911460 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:40.917921 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e52c908c-25bb-482d-9c0a-08cd8a911460 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:40.918354 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e52c908c-25bb-482d-9c0a-08cd8a911460 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:40.928991 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e2434b48-0951-451b-8711-f6ef2599b200 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 28749 microversion: 2.1 time: 0.217492 Nov 12 02:29:40.929648 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 346/667] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:40 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 28749 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:41.000926 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0cfbca9e-4fc3-4df6-8340-f3e4cf17ba6b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:41.001641 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0cfbca9e-4fc3-4df6-8340-f3e4cf17ba6b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:41.009658 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0cfbca9e-4fc3-4df6-8340-f3e4cf17ba6b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:41.010112 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0cfbca9e-4fc3-4df6-8340-f3e4cf17ba6b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:41.010957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0cfbca9e-4fc3-4df6-8340-f3e4cf17ba6b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:41.011395 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0cfbca9e-4fc3-4df6-8340-f3e4cf17ba6b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:41.117079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e52c908c-25bb-482d-9c0a-08cd8a911460 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:41.127628 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e52c908c-25bb-482d-9c0a-08cd8a911460 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1317 microversion: 2.1 time: 0.223207 Nov 12 02:29:41.128213 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 322/668] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:40 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:41.186978 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0cfbca9e-4fc3-4df6-8340-f3e4cf17ba6b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:41.196463 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0cfbca9e-4fc3-4df6-8340-f3e4cf17ba6b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.200336 Nov 12 02:29:41.197035 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 347/669] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:40 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:41.914065 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7d289948-4a95-417f-be73-e1642ca8138e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:41.915017 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7d289948-4a95-417f-be73-e1642ca8138e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:41.921450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d289948-4a95-417f-be73-e1642ca8138e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:41.921919 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d289948-4a95-417f-be73-e1642ca8138e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:41.922733 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d289948-4a95-417f-be73-e1642ca8138e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:41.923170 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7d289948-4a95-417f-be73-e1642ca8138e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:41.940990 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3df09045-3b59-40d3-8cc0-e3ab1aaa96ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:41.941939 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3df09045-3b59-40d3-8cc0-e3ab1aaa96ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:41.948501 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3df09045-3b59-40d3-8cc0-e3ab1aaa96ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:41.948959 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3df09045-3b59-40d3-8cc0-e3ab1aaa96ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:41.949750 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3df09045-3b59-40d3-8cc0-e3ab1aaa96ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:41.950198 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3df09045-3b59-40d3-8cc0-e3ab1aaa96ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:42.085676 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7d289948-4a95-417f-be73-e1642ca8138e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 30368 microversion: 2.20 time: 0.175722 Nov 12 02:29:42.086335 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 323/670] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:41 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 30368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:42.119989 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3df09045-3b59-40d3-8cc0-e3ab1aaa96ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 30509 microversion: 2.1 time: 0.182491 Nov 12 02:29:42.120633 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 348/671] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:41 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 30509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:42.146160 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-663a38d7-c77a-4bfe-9822-eddcc876dec9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:42.146928 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-663a38d7-c77a-4bfe-9822-eddcc876dec9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:42.155413 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-663a38d7-c77a-4bfe-9822-eddcc876dec9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:42.155954 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-663a38d7-c77a-4bfe-9822-eddcc876dec9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:42.156749 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-663a38d7-c77a-4bfe-9822-eddcc876dec9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:42.157191 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-663a38d7-c77a-4bfe-9822-eddcc876dec9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:42.214742 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f7a64dd5-cb37-4893-8d69-c7fa2cca68d3 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:42.215579 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f7a64dd5-cb37-4893-8d69-c7fa2cca68d3 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:42.222598 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f7a64dd5-cb37-4893-8d69-c7fa2cca68d3 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:42.223092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f7a64dd5-cb37-4893-8d69-c7fa2cca68d3 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:42.223885 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f7a64dd5-cb37-4893-8d69-c7fa2cca68d3 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:42.224320 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f7a64dd5-cb37-4893-8d69-c7fa2cca68d3 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:42.324746 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-663a38d7-c77a-4bfe-9822-eddcc876dec9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:42.333172 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-663a38d7-c77a-4bfe-9822-eddcc876dec9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1507 microversion: 2.1 time: 0.191164 Nov 12 02:29:42.333845 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 324/672] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:42 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:42.401930 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f7a64dd5-cb37-4893-8d69-c7fa2cca68d3 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:42.404506 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f7a64dd5-cb37-4893-8d69-c7fa2cca68d3 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.193917 Nov 12 02:29:42.405106 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 349/673] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:42 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:43.097781 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ce1ab2b2-d521-4d00-89eb-60a6d4507bec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:43.102386 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ce1ab2b2-d521-4d00-89eb-60a6d4507bec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:43.108090 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce1ab2b2-d521-4d00-89eb-60a6d4507bec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:43.108543 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce1ab2b2-d521-4d00-89eb-60a6d4507bec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:43.109333 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce1ab2b2-d521-4d00-89eb-60a6d4507bec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:43.109771 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce1ab2b2-d521-4d00-89eb-60a6d4507bec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:43.131354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3b656255-4fed-4d15-9885-269f4dbe9b32 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:43.132274 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3b656255-4fed-4d15-9885-269f4dbe9b32 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:43.138510 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3b656255-4fed-4d15-9885-269f4dbe9b32 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:43.139705 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3b656255-4fed-4d15-9885-269f4dbe9b32 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:43.140539 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3b656255-4fed-4d15-9885-269f4dbe9b32 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:43.140982 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3b656255-4fed-4d15-9885-269f4dbe9b32 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:43.240334 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ce1ab2b2-d521-4d00-89eb-60a6d4507bec tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 31480 microversion: 2.20 time: 0.146038 Nov 12 02:29:43.240988 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 325/674] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:43 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 31480 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:43.290314 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3b656255-4fed-4d15-9885-269f4dbe9b32 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 31639 microversion: 2.1 time: 0.162514 Nov 12 02:29:43.290995 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 350/675] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:43 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 31639 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:43.423233 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-efff424a-acd1-4edc-8c7a-9d1c2b04d7d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:43.423920 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-efff424a-acd1-4edc-8c7a-9d1c2b04d7d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:43.431235 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-efff424a-acd1-4edc-8c7a-9d1c2b04d7d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:43.431679 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-efff424a-acd1-4edc-8c7a-9d1c2b04d7d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:43.432448 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-efff424a-acd1-4edc-8c7a-9d1c2b04d7d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:43.432878 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-efff424a-acd1-4edc-8c7a-9d1c2b04d7d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:43.570552 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-efff424a-acd1-4edc-8c7a-9d1c2b04d7d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:43.578793 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-efff424a-acd1-4edc-8c7a-9d1c2b04d7d5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.159557 Nov 12 02:29:43.579348 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 326/676] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:43 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:44.252725 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e4822727-3c0c-4915-9cd3-810a76251b8a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:44.253711 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e4822727-3c0c-4915-9cd3-810a76251b8a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:44.260634 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e4822727-3c0c-4915-9cd3-810a76251b8a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:44.261082 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e4822727-3c0c-4915-9cd3-810a76251b8a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:44.261860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e4822727-3c0c-4915-9cd3-810a76251b8a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:44.262297 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e4822727-3c0c-4915-9cd3-810a76251b8a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:44.302096 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2b7dc295-b0d1-452e-a15d-ef86542ddc23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:44.303058 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2b7dc295-b0d1-452e-a15d-ef86542ddc23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:44.309822 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2b7dc295-b0d1-452e-a15d-ef86542ddc23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:44.310271 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2b7dc295-b0d1-452e-a15d-ef86542ddc23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:44.311099 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2b7dc295-b0d1-452e-a15d-ef86542ddc23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:44.311778 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2b7dc295-b0d1-452e-a15d-ef86542ddc23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:44.710291 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e4822727-3c0c-4915-9cd3-810a76251b8a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 32579 microversion: 2.20 time: 0.461460 Nov 12 02:29:44.714179 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 351/677] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:44 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 32579 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:44.716253 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-254e6945-b393-4b39-b4a1-703f2dea0ba0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:44.716967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-254e6945-b393-4b39-b4a1-703f2dea0ba0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:44.724637 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-254e6945-b393-4b39-b4a1-703f2dea0ba0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:44.731976 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-254e6945-b393-4b39-b4a1-703f2dea0ba0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:44.732791 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-254e6945-b393-4b39-b4a1-703f2dea0ba0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:44.733237 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-254e6945-b393-4b39-b4a1-703f2dea0ba0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:44.809820 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2b7dc295-b0d1-452e-a15d-ef86542ddc23 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 32704 microversion: 2.1 time: 0.511055 Nov 12 02:29:44.813852 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 327/678] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:44 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 32704 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:44.816940 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-968344d8-a73a-471f-ba28-82e59e84ce63 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e39facc-46e8-4f6e-9a02-8bbfb88dd228"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:44.818088 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-968344d8-a73a-471f-ba28-82e59e84ce63 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:44.825076 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-968344d8-a73a-471f-ba28-82e59e84ce63 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:44.825656 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-968344d8-a73a-471f-ba28-82e59e84ce63 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:44.826437 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-968344d8-a73a-471f-ba28-82e59e84ce63 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:44.826912 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-968344d8-a73a-471f-ba28-82e59e84ce63 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:44.884980 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-254e6945-b393-4b39-b4a1-703f2dea0ba0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:44.892583 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-254e6945-b393-4b39-b4a1-703f2dea0ba0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.180342 Nov 12 02:29:44.893347 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 352/679] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:44 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:45.108554 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-968344d8-a73a-471f-ba28-82e59e84ce63 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "POST /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296616 Nov 12 02:29:45.109158 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 328/680] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:29:44 2021] POST /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:29:45.722029 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-90b0dced-8896-405c-b852-63376e82a2d2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:45.723550 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-90b0dced-8896-405c-b852-63376e82a2d2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:45.729721 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-90b0dced-8896-405c-b852-63376e82a2d2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:45.730206 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-90b0dced-8896-405c-b852-63376e82a2d2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:45.731006 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-90b0dced-8896-405c-b852-63376e82a2d2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:45.731440 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-90b0dced-8896-405c-b852-63376e82a2d2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:45.822363 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-37a6224d-bf48-4863-8edc-a05f3da01486 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:45.823436 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-37a6224d-bf48-4863-8edc-a05f3da01486 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:45.829585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37a6224d-bf48-4863-8edc-a05f3da01486 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:45.830037 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37a6224d-bf48-4863-8edc-a05f3da01486 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:45.830848 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37a6224d-bf48-4863-8edc-a05f3da01486 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:45.831291 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37a6224d-bf48-4863-8edc-a05f3da01486 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:45.888510 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-90b0dced-8896-405c-b852-63376e82a2d2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 33159 microversion: 2.20 time: 0.169966 Nov 12 02:29:45.889167 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 353/681] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:45 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 33159 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:45.909226 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4068133c-1e7f-4d91-8876-68467d70f388 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:45.909920 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4068133c-1e7f-4d91-8876-68467d70f388 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:45.917368 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4068133c-1e7f-4d91-8876-68467d70f388 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:45.917818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4068133c-1e7f-4d91-8876-68467d70f388 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:45.918607 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4068133c-1e7f-4d91-8876-68467d70f388 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:45.919069 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4068133c-1e7f-4d91-8876-68467d70f388 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:45.982717 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-37a6224d-bf48-4863-8edc-a05f3da01486 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 33250 microversion: 2.1 time: 0.164193 Nov 12 02:29:45.982990 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 329/682] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:45 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 33250 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:46.053953 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4068133c-1e7f-4d91-8876-68467d70f388 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:46.061605 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4068133c-1e7f-4d91-8876-68467d70f388 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1565 microversion: 2.1 time: 0.156208 Nov 12 02:29:46.062164 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 354/683] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:45 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:46.901441 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e04c308f-1b46-4d34-86cf-093f755cb18d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:46.902503 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e04c308f-1b46-4d34-86cf-093f755cb18d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:46.909957 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e04c308f-1b46-4d34-86cf-093f755cb18d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:46.910957 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e04c308f-1b46-4d34-86cf-093f755cb18d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:46.911750 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e04c308f-1b46-4d34-86cf-093f755cb18d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:46.912183 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e04c308f-1b46-4d34-86cf-093f755cb18d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:46.994855 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e9b68793-181c-4711-93a7-19b819bb6450 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:46.995786 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e9b68793-181c-4711-93a7-19b819bb6450 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:47.002164 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e9b68793-181c-4711-93a7-19b819bb6450 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:47.002603 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e9b68793-181c-4711-93a7-19b819bb6450 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:47.003406 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e9b68793-181c-4711-93a7-19b819bb6450 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:47.003836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e9b68793-181c-4711-93a7-19b819bb6450 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:47.033713 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e04c308f-1b46-4d34-86cf-093f755cb18d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 33656 microversion: 2.20 time: 0.136485 Nov 12 02:29:47.034385 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 330/684] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:46 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 33656 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:47.078300 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8e4f98e3-8cf2-47c6-91a1-99b64cef94c4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:47.079045 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8e4f98e3-8cf2-47c6-91a1-99b64cef94c4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:47.086506 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8e4f98e3-8cf2-47c6-91a1-99b64cef94c4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:47.086993 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8e4f98e3-8cf2-47c6-91a1-99b64cef94c4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:47.087788 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8e4f98e3-8cf2-47c6-91a1-99b64cef94c4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:47.088252 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8e4f98e3-8cf2-47c6-91a1-99b64cef94c4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:47.154528 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e9b68793-181c-4711-93a7-19b819bb6450 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 33844 microversion: 2.1 time: 0.163403 Nov 12 02:29:47.155407 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 355/685] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:46 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 33844 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:47.225599 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8e4f98e3-8cf2-47c6-91a1-99b64cef94c4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:47.233655 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8e4f98e3-8cf2-47c6-91a1-99b64cef94c4 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1545 microversion: 2.1 time: 0.159574 Nov 12 02:29:47.234303 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 331/686] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:47 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1545 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:47.251025 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-302d579d-ae85-4157-907e-e93b85907913 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:47.251594 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-302d579d-ae85-4157-907e-e93b85907913 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:47.258847 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-302d579d-ae85-4157-907e-e93b85907913 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:47.259507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-302d579d-ae85-4157-907e-e93b85907913 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:47.260439 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-302d579d-ae85-4157-907e-e93b85907913 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:47.260871 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-302d579d-ae85-4157-907e-e93b85907913 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:47.338475 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-302d579d-ae85-4157-907e-e93b85907913 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] HTTP exception thrown: Cannot 'detach_volume' instance 44c025f0-3bb5-4ce5-944f-0f553ef80f8a while it is in vm_state rescued Nov 12 02:29:47.339119 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-302d579d-ae85-4157-907e-e93b85907913 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Returning 409 to user: Cannot 'detach_volume' instance 44c025f0-3bb5-4ce5-944f-0f553ef80f8a while it is in vm_state rescued {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:29:47.339972 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-302d579d-ae85-4157-907e-e93b85907913 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "DELETE /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments/8b41d7ae-d719-437a-b7e8-42ba79f34a0d" status: 409 len: 152 microversion: 2.1 time: 0.093155 Nov 12 02:29:47.340548 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 356/687] 10.222.0.70 () {58 vars in 1415 bytes} [Fri Nov 12 02:29:47 2021] DELETE /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments/8b41d7ae-d719-437a-b7e8-42ba79f34a0d => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 12 02:29:47.348861 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ed437307-5630-4cee-b297-4dccf5caf973 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:47.349388 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ed437307-5630-4cee-b297-4dccf5caf973 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:47.355735 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ed437307-5630-4cee-b297-4dccf5caf973 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:47.356179 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ed437307-5630-4cee-b297-4dccf5caf973 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:47.356951 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ed437307-5630-4cee-b297-4dccf5caf973 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:47.357378 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ed437307-5630-4cee-b297-4dccf5caf973 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:47.424909 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ed437307-5630-4cee-b297-4dccf5caf973 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "POST /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/action" status: 202 len: 0 microversion: 2.1 time: 0.079417 Nov 12 02:29:47.425798 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 332/688] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:47 2021] POST /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:47.434286 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6ea1287c-0309-4459-9c0c-2b821215da67 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:47.434935 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6ea1287c-0309-4459-9c0c-2b821215da67 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:47.443892 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ea1287c-0309-4459-9c0c-2b821215da67 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:47.444350 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ea1287c-0309-4459-9c0c-2b821215da67 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:47.445149 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ea1287c-0309-4459-9c0c-2b821215da67 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:47.445592 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ea1287c-0309-4459-9c0c-2b821215da67 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:47.586894 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6ea1287c-0309-4459-9c0c-2b821215da67 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:47.595134 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6ea1287c-0309-4459-9c0c-2b821215da67 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1553 microversion: 2.1 time: 0.164321 Nov 12 02:29:47.595735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 357/689] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:47 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:48.046288 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4c5f9afe-55ff-4c4c-8240-74b31e6196fa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:48.047313 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4c5f9afe-55ff-4c4c-8240-74b31e6196fa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:48.054215 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c5f9afe-55ff-4c4c-8240-74b31e6196fa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:48.054656 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c5f9afe-55ff-4c4c-8240-74b31e6196fa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:48.055468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c5f9afe-55ff-4c4c-8240-74b31e6196fa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:48.055903 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4c5f9afe-55ff-4c4c-8240-74b31e6196fa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:48.165426 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-63eea4d3-6b8c-44d1-a00f-8839ac3d59dc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:48.166391 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-63eea4d3-6b8c-44d1-a00f-8839ac3d59dc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:48.172740 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-63eea4d3-6b8c-44d1-a00f-8839ac3d59dc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:48.173189 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-63eea4d3-6b8c-44d1-a00f-8839ac3d59dc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:48.173965 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-63eea4d3-6b8c-44d1-a00f-8839ac3d59dc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:48.174404 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-63eea4d3-6b8c-44d1-a00f-8839ac3d59dc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:48.229426 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4c5f9afe-55ff-4c4c-8240-74b31e6196fa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 34546 microversion: 2.20 time: 0.187366 Nov 12 02:29:48.230048 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 333/690] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:48 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 34546 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:48.322232 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-63eea4d3-6b8c-44d1-a00f-8839ac3d59dc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 34805 microversion: 2.1 time: 0.160268 Nov 12 02:29:48.322903 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 358/691] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:48 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 34805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:48.614081 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2e0262c6-25c1-4190-8ffd-d4f0d14544ff tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:48.614809 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2e0262c6-25c1-4190-8ffd-d4f0d14544ff tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:48.622589 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e0262c6-25c1-4190-8ffd-d4f0d14544ff tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:48.623075 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e0262c6-25c1-4190-8ffd-d4f0d14544ff tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:48.623869 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e0262c6-25c1-4190-8ffd-d4f0d14544ff tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:48.624308 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e0262c6-25c1-4190-8ffd-d4f0d14544ff tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:48.763249 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2e0262c6-25c1-4190-8ffd-d4f0d14544ff tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:48.771990 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2e0262c6-25c1-4190-8ffd-d4f0d14544ff tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1553 microversion: 2.1 time: 0.162037 Nov 12 02:29:48.772567 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 334/692] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:48 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:49.241872 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ac623c8b-0020-4575-b49d-3ff4953e4d86 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:49.243178 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ac623c8b-0020-4575-b49d-3ff4953e4d86 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:49.250028 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ac623c8b-0020-4575-b49d-3ff4953e4d86 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:49.250474 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ac623c8b-0020-4575-b49d-3ff4953e4d86 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:49.251290 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ac623c8b-0020-4575-b49d-3ff4953e4d86 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:49.251725 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ac623c8b-0020-4575-b49d-3ff4953e4d86 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:49.333868 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b270838a-b5a4-4f8b-be5e-fa0620802488 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:49.334841 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b270838a-b5a4-4f8b-be5e-fa0620802488 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:49.341268 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b270838a-b5a4-4f8b-be5e-fa0620802488 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:49.341710 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b270838a-b5a4-4f8b-be5e-fa0620802488 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:49.342499 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b270838a-b5a4-4f8b-be5e-fa0620802488 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:49.342962 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b270838a-b5a4-4f8b-be5e-fa0620802488 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:49.377358 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ac623c8b-0020-4575-b49d-3ff4953e4d86 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 35448 microversion: 2.20 time: 0.139410 Nov 12 02:29:49.378034 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 359/693] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:49 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 35448 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:49.535116 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b270838a-b5a4-4f8b-be5e-fa0620802488 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 35674 microversion: 2.1 time: 0.204535 Nov 12 02:29:49.535680 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 335/694] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:49 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 35674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:49.790078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-74a34150-145f-4bfd-ab4b-7d5d1c6bdb3b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:49.790754 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-74a34150-145f-4bfd-ab4b-7d5d1c6bdb3b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:49.797637 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-74a34150-145f-4bfd-ab4b-7d5d1c6bdb3b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:49.798090 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-74a34150-145f-4bfd-ab4b-7d5d1c6bdb3b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:49.798931 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-74a34150-145f-4bfd-ab4b-7d5d1c6bdb3b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:49.799370 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-74a34150-145f-4bfd-ab4b-7d5d1c6bdb3b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:49.941047 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-74a34150-145f-4bfd-ab4b-7d5d1c6bdb3b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:49.949165 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-74a34150-145f-4bfd-ab4b-7d5d1c6bdb3b tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1553 microversion: 2.1 time: 0.163704 Nov 12 02:29:49.949738 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 360/695] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:49 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:50.390048 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-51b10e2d-c2d5-4798-a206-333fb661039c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:50.391204 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-51b10e2d-c2d5-4798-a206-333fb661039c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:50.398849 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-51b10e2d-c2d5-4798-a206-333fb661039c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:50.399274 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-51b10e2d-c2d5-4798-a206-333fb661039c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:50.400069 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-51b10e2d-c2d5-4798-a206-333fb661039c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:50.400509 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-51b10e2d-c2d5-4798-a206-333fb661039c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:50.539582 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-51b10e2d-c2d5-4798-a206-333fb661039c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 36632 microversion: 2.20 time: 0.153188 Nov 12 02:29:50.540258 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 336/696] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:50 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 36632 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:50.547083 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-99442640-b24b-42a8-a9f2-b3a0eba21eb2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:50.548004 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-99442640-b24b-42a8-a9f2-b3a0eba21eb2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:50.554413 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-99442640-b24b-42a8-a9f2-b3a0eba21eb2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:50.554916 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-99442640-b24b-42a8-a9f2-b3a0eba21eb2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:50.555695 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-99442640-b24b-42a8-a9f2-b3a0eba21eb2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:50.556130 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-99442640-b24b-42a8-a9f2-b3a0eba21eb2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:50.666164 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-99442640-b24b-42a8-a9f2-b3a0eba21eb2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 36766 microversion: 2.1 time: 0.122773 Nov 12 02:29:50.666779 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 361/697] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:50 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 36766 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:50.966815 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5811b307-4cb7-4715-8347-9effe4dc70a5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:50.967430 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5811b307-4cb7-4715-8347-9effe4dc70a5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:50.975524 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5811b307-4cb7-4715-8347-9effe4dc70a5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:50.975973 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5811b307-4cb7-4715-8347-9effe4dc70a5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:50.976767 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5811b307-4cb7-4715-8347-9effe4dc70a5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:50.977209 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5811b307-4cb7-4715-8347-9effe4dc70a5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:51.108274 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5811b307-4cb7-4715-8347-9effe4dc70a5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:51.117165 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5811b307-4cb7-4715-8347-9effe4dc70a5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1553 microversion: 2.1 time: 0.154490 Nov 12 02:29:51.117995 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 337/698] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:50 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:51.554651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-12403650-873a-43b7-bb5a-0f0bc31ce2cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:51.555668 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-12403650-873a-43b7-bb5a-0f0bc31ce2cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:51.562582 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12403650-873a-43b7-bb5a-0f0bc31ce2cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:51.563052 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12403650-873a-43b7-bb5a-0f0bc31ce2cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:51.563835 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12403650-873a-43b7-bb5a-0f0bc31ce2cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:51.564273 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12403650-873a-43b7-bb5a-0f0bc31ce2cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:51.678732 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d0720f5b-160b-435c-b79c-4d43c2d724a8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:51.679598 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d0720f5b-160b-435c-b79c-4d43c2d724a8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:51.686182 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d0720f5b-160b-435c-b79c-4d43c2d724a8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:51.686629 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d0720f5b-160b-435c-b79c-4d43c2d724a8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:51.687441 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d0720f5b-160b-435c-b79c-4d43c2d724a8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:51.687875 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d0720f5b-160b-435c-b79c-4d43c2d724a8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:51.728433 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-12403650-873a-43b7-bb5a-0f0bc31ce2cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 37579 microversion: 2.20 time: 0.178919 Nov 12 02:29:51.729275 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 362/699] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:51 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 37579 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:29:51.898542 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d0720f5b-160b-435c-b79c-4d43c2d724a8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 37852 microversion: 2.1 time: 0.224093 Nov 12 02:29:51.899251 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 338/700] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:51 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 37852 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:52.134601 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f56b6f4f-f8cc-497d-aa5d-95ccfe22409d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:52.135359 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f56b6f4f-f8cc-497d-aa5d-95ccfe22409d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:52.142709 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f56b6f4f-f8cc-497d-aa5d-95ccfe22409d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:52.143143 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f56b6f4f-f8cc-497d-aa5d-95ccfe22409d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:52.143938 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f56b6f4f-f8cc-497d-aa5d-95ccfe22409d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:52.144441 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f56b6f4f-f8cc-497d-aa5d-95ccfe22409d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:52.276160 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f56b6f4f-f8cc-497d-aa5d-95ccfe22409d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:52.284608 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f56b6f4f-f8cc-497d-aa5d-95ccfe22409d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1559 microversion: 2.1 time: 0.154108 Nov 12 02:29:52.285750 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 363/701] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:52 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:52.360908 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f14a951e-86cd-4084-91a3-275a99bbe6ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:52.361830 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f14a951e-86cd-4084-91a3-275a99bbe6ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:52.371053 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f14a951e-86cd-4084-91a3-275a99bbe6ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:52.371542 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f14a951e-86cd-4084-91a3-275a99bbe6ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:52.372326 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f14a951e-86cd-4084-91a3-275a99bbe6ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:52.372777 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f14a951e-86cd-4084-91a3-275a99bbe6ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:52.451969 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-f14a951e-86cd-4084-91a3-275a99bbe6ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lazy-loading 'services' on Instance uuid 44c025f0-3bb5-4ce5-944f-0f553ef80f8a {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:29:52.540876 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f14a951e-86cd-4084-91a3-275a99bbe6ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "DELETE /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments/8b41d7ae-d719-437a-b7e8-42ba79f34a0d" status: 202 len: 0 microversion: 2.1 time: 0.187299 Nov 12 02:29:52.542163 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 339/702] 10.222.0.70 () {58 vars in 1415 bytes} [Fri Nov 12 02:29:52 2021] DELETE /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments/8b41d7ae-d719-437a-b7e8-42ba79f34a0d => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:52.557264 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-eac41f90-b635-49f8-aa9c-4c26ea4851c9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:52.558377 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-eac41f90-b635-49f8-aa9c-4c26ea4851c9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:52.565251 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eac41f90-b635-49f8-aa9c-4c26ea4851c9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:52.565836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eac41f90-b635-49f8-aa9c-4c26ea4851c9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:52.566684 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eac41f90-b635-49f8-aa9c-4c26ea4851c9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:52.567121 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-eac41f90-b635-49f8-aa9c-4c26ea4851c9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:52.599498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-eac41f90-b635-49f8-aa9c-4c26ea4851c9 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046222 Nov 12 02:29:52.600070 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 364/703] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:29:52 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:29:52.742109 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-36d6869b-5f3a-4056-a471-ad827a953cc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:52.743444 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-36d6869b-5f3a-4056-a471-ad827a953cc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:52.749544 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36d6869b-5f3a-4056-a471-ad827a953cc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:52.749989 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36d6869b-5f3a-4056-a471-ad827a953cc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:52.750793 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36d6869b-5f3a-4056-a471-ad827a953cc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:52.751225 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36d6869b-5f3a-4056-a471-ad827a953cc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:52.866856 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-36d6869b-5f3a-4056-a471-ad827a953cc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 38130 microversion: 2.20 time: 0.129571 Nov 12 02:29:52.867766 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 340/704] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:52 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 38130 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:52.910063 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-56087855-f44d-4a37-91c1-c3f3ed97127e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:52.911578 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-56087855-f44d-4a37-91c1-c3f3ed97127e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:52.918760 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-56087855-f44d-4a37-91c1-c3f3ed97127e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:52.919664 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-56087855-f44d-4a37-91c1-c3f3ed97127e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:52.920551 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-56087855-f44d-4a37-91c1-c3f3ed97127e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:52.920991 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-56087855-f44d-4a37-91c1-c3f3ed97127e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:53.070618 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-56087855-f44d-4a37-91c1-c3f3ed97127e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 38250 microversion: 2.1 time: 0.164169 Nov 12 02:29:53.071752 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 365/705] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:52 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 38250 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:53.612801 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4595def3-642f-4a82-8152-eb9a16516927 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:53.613938 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4595def3-642f-4a82-8152-eb9a16516927 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:53.621526 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4595def3-642f-4a82-8152-eb9a16516927 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:53.621984 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4595def3-642f-4a82-8152-eb9a16516927 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:53.622816 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4595def3-642f-4a82-8152-eb9a16516927 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:53.623261 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4595def3-642f-4a82-8152-eb9a16516927 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:53.661971 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4595def3-642f-4a82-8152-eb9a16516927 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053078 Nov 12 02:29:53.662962 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 341/706] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:29:53 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:29:53.741695 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1129a967-4e4b-4e09-bb09-d99bf2f72cac tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:53.743100 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1129a967-4e4b-4e09-bb09-d99bf2f72cac tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:53.750503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1129a967-4e4b-4e09-bb09-d99bf2f72cac tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:53.751721 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1129a967-4e4b-4e09-bb09-d99bf2f72cac tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:53.752573 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1129a967-4e4b-4e09-bb09-d99bf2f72cac tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:53.753116 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1129a967-4e4b-4e09-bb09-d99bf2f72cac tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:53.836910 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-1129a967-4e4b-4e09-bb09-d99bf2f72cac tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lazy-loading 'services' on Instance uuid f77f715d-8c97-4b1e-97e6-bc2113bcfdda {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:29:53.891843 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-654cb0be-fbed-412f-9725-cb986db9978c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:53.893140 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-654cb0be-fbed-412f-9725-cb986db9978c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:53.899791 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-654cb0be-fbed-412f-9725-cb986db9978c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:53.900239 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-654cb0be-fbed-412f-9725-cb986db9978c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:53.901067 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-654cb0be-fbed-412f-9725-cb986db9978c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:53.901534 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-654cb0be-fbed-412f-9725-cb986db9978c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:53.912075 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1129a967-4e4b-4e09-bb09-d99bf2f72cac tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda/os-volume_attachments/5e39facc-46e8-4f6e-9a02-8bbfb88dd228" status: 202 len: 0 microversion: 2.1 time: 0.176671 Nov 12 02:29:53.912917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 366/707] 10.222.0.70 () {58 vars in 1415 bytes} [Fri Nov 12 02:29:53 2021] DELETE /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda/os-volume_attachments/5e39facc-46e8-4f6e-9a02-8bbfb88dd228 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:53.921414 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-090afe62-f1c8-4164-9dde-0933deaeeeb8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:53.922426 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-090afe62-f1c8-4164-9dde-0933deaeeeb8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:53.929426 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-090afe62-f1c8-4164-9dde-0933deaeeeb8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:53.929869 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-090afe62-f1c8-4164-9dde-0933deaeeeb8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:53.930789 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-090afe62-f1c8-4164-9dde-0933deaeeeb8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:53.931372 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-090afe62-f1c8-4164-9dde-0933deaeeeb8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:53.961160 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-090afe62-f1c8-4164-9dde-0933deaeeeb8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Nov 12 02:29:53.961708 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 367/708] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:29:53 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:29:54.030484 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-654cb0be-fbed-412f-9725-cb986db9978c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 38130 microversion: 2.20 time: 0.143392 Nov 12 02:29:54.031160 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 342/709] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:53 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 38130 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:54.082790 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5e490612-b309-4c91-8308-9ebd600fe952 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:54.083700 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5e490612-b309-4c91-8308-9ebd600fe952 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:54.091131 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5e490612-b309-4c91-8308-9ebd600fe952 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:54.091579 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5e490612-b309-4c91-8308-9ebd600fe952 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:54.092363 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5e490612-b309-4c91-8308-9ebd600fe952 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:54.092827 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5e490612-b309-4c91-8308-9ebd600fe952 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:54.201663 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5e490612-b309-4c91-8308-9ebd600fe952 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 38250 microversion: 2.1 time: 0.122940 Nov 12 02:29:54.202570 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 368/710] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:54 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 38250 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:54.676361 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-de121896-54a9-4635-b612-3d691eeb2c61 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:54.677479 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-de121896-54a9-4635-b612-3d691eeb2c61 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:54.684298 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-de121896-54a9-4635-b612-3d691eeb2c61 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:54.684742 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-de121896-54a9-4635-b612-3d691eeb2c61 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:54.685512 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-de121896-54a9-4635-b612-3d691eeb2c61 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:54.685946 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-de121896-54a9-4635-b612-3d691eeb2c61 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:54.716291 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-de121896-54a9-4635-b612-3d691eeb2c61 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043964 Nov 12 02:29:54.716839 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 343/711] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:29:54 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 12 02:29:54.973814 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e8e6eb42-32bb-4d83-a4e9-6db63cd7f8a5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:54.974784 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e8e6eb42-32bb-4d83-a4e9-6db63cd7f8a5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:54.981969 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8e6eb42-32bb-4d83-a4e9-6db63cd7f8a5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:54.982435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8e6eb42-32bb-4d83-a4e9-6db63cd7f8a5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:54.983251 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8e6eb42-32bb-4d83-a4e9-6db63cd7f8a5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:54.983688 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8e6eb42-32bb-4d83-a4e9-6db63cd7f8a5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:55.013181 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e8e6eb42-32bb-4d83-a4e9-6db63cd7f8a5 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043581 Nov 12 02:29:55.013742 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 369/712] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:29:54 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:29:55.043304 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4fe0dd70-50eb-4f1c-92a6-7dceb0c05f79 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:55.044213 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4fe0dd70-50eb-4f1c-92a6-7dceb0c05f79 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:55.050355 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fe0dd70-50eb-4f1c-92a6-7dceb0c05f79 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:55.050868 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fe0dd70-50eb-4f1c-92a6-7dceb0c05f79 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:55.051636 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fe0dd70-50eb-4f1c-92a6-7dceb0c05f79 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:55.052067 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4fe0dd70-50eb-4f1c-92a6-7dceb0c05f79 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:55.164090 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4fe0dd70-50eb-4f1c-92a6-7dceb0c05f79 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 38130 microversion: 2.20 time: 0.124212 Nov 12 02:29:55.164737 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 344/713] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:55 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 38130 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:55.214817 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3d6ab48a-38ad-46c0-81fc-27955f05c98c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:55.215952 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3d6ab48a-38ad-46c0-81fc-27955f05c98c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:55.222170 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d6ab48a-38ad-46c0-81fc-27955f05c98c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:55.223226 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d6ab48a-38ad-46c0-81fc-27955f05c98c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:55.224056 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d6ab48a-38ad-46c0-81fc-27955f05c98c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:55.224637 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d6ab48a-38ad-46c0-81fc-27955f05c98c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:55.337965 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3d6ab48a-38ad-46c0-81fc-27955f05c98c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 38250 microversion: 2.1 time: 0.127456 Nov 12 02:29:55.338637 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 370/714] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:55 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 38250 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:56.027528 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6392ef8e-597c-4f12-8c29-71087bf75ee1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:56.028712 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6392ef8e-597c-4f12-8c29-71087bf75ee1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:56.036334 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6392ef8e-597c-4f12-8c29-71087bf75ee1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:56.036906 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6392ef8e-597c-4f12-8c29-71087bf75ee1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:56.037733 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6392ef8e-597c-4f12-8c29-71087bf75ee1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:56.038175 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6392ef8e-597c-4f12-8c29-71087bf75ee1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:56.074466 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6392ef8e-597c-4f12-8c29-71087bf75ee1 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052781 Nov 12 02:29:56.075200 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 345/715] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:29:56 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:29:56.177395 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6f4ae59e-b097-4f38-96ff-eef40c48d703 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:56.178607 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6f4ae59e-b097-4f38-96ff-eef40c48d703 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:56.186207 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6f4ae59e-b097-4f38-96ff-eef40c48d703 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:56.186757 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6f4ae59e-b097-4f38-96ff-eef40c48d703 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:56.187526 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6f4ae59e-b097-4f38-96ff-eef40c48d703 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:56.188027 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6f4ae59e-b097-4f38-96ff-eef40c48d703 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:56.309723 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6f4ae59e-b097-4f38-96ff-eef40c48d703 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 200 len: 38273 microversion: 2.20 time: 0.136744 Nov 12 02:29:56.310383 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 371/716] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:56 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 38273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:29:56.321588 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-76cad391-0436-4675-bf0e-8c81b55a2f0b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:56.322383 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-76cad391-0436-4675-bf0e-8c81b55a2f0b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:56.329236 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76cad391-0436-4675-bf0e-8c81b55a2f0b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:56.329747 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76cad391-0436-4675-bf0e-8c81b55a2f0b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:56.330659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76cad391-0436-4675-bf0e-8c81b55a2f0b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:56.331128 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76cad391-0436-4675-bf0e-8c81b55a2f0b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:56.351253 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-87ddb640-c30b-47a3-bace-48e128d7ea75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:56.352674 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-87ddb640-c30b-47a3-bace-48e128d7ea75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:56.360951 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-76cad391-0436-4675-bf0e-8c81b55a2f0b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/ips" status: 200 len: 150 microversion: 2.20 time: 0.039215 Nov 12 02:29:56.360951 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 346/717] 10.222.0.70 () {60 vars in 1288 bytes} [Fri Nov 12 02:29:56 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:29:56.361257 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-87ddb640-c30b-47a3-bace-48e128d7ea75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:56.361257 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-87ddb640-c30b-47a3-bace-48e128d7ea75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:56.361444 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-87ddb640-c30b-47a3-bace-48e128d7ea75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:56.361934 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-87ddb640-c30b-47a3-bace-48e128d7ea75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:56.488036 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-87ddb640-c30b-47a3-bace-48e128d7ea75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 200 len: 38379 microversion: 2.1 time: 0.141932 Nov 12 02:29:56.495501 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 372/718] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:29:56 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 38379 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:29:56.500589 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a5fc9e17-2d96-4fe3-840b-cb1d8b819ea1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:56.501085 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a5fc9e17-2d96-4fe3-840b-cb1d8b819ea1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:56.508847 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a5fc9e17-2d96-4fe3-840b-cb1d8b819ea1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:56.509299 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a5fc9e17-2d96-4fe3-840b-cb1d8b819ea1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:56.510194 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a5fc9e17-2d96-4fe3-840b-cb1d8b819ea1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:56.510631 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a5fc9e17-2d96-4fe3-840b-cb1d8b819ea1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:56.540584 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a5fc9e17-2d96-4fe3-840b-cb1d8b819ea1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/ips" status: 200 len: 145 microversion: 2.1 time: 0.043532 Nov 12 02:29:56.541210 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 347/719] 10.222.0.70 () {58 vars in 1247 bytes} [Fri Nov 12 02:29:56 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:29:57.032625 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-25d8bcd6-392c-439b-8f27-1244e7e2f1b5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:57.033213 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-25d8bcd6-392c-439b-8f27-1244e7e2f1b5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:57.041156 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-25d8bcd6-392c-439b-8f27-1244e7e2f1b5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:57.041615 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-25d8bcd6-392c-439b-8f27-1244e7e2f1b5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:57.042688 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-25d8bcd6-392c-439b-8f27-1244e7e2f1b5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:57.043130 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-25d8bcd6-392c-439b-8f27-1244e7e2f1b5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:57.070094 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-25d8bcd6-392c-439b-8f27-1244e7e2f1b5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Going to try to terminate instance {{(pid=116099) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:29:57.146712 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-25d8bcd6-392c-439b-8f27-1244e7e2f1b5 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "DELETE /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 204 len: 0 microversion: 2.1 time: 0.117603 Nov 12 02:29:57.147574 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 373/720] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:29:57 2021] DELETE /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:29:57.157427 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c22a4606-5a03-4cf2-b72d-3cfd64928187 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:57.158185 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c22a4606-5a03-4cf2-b72d-3cfd64928187 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:57.165634 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c22a4606-5a03-4cf2-b72d-3cfd64928187 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:57.166079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c22a4606-5a03-4cf2-b72d-3cfd64928187 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:57.166891 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c22a4606-5a03-4cf2-b72d-3cfd64928187 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:57.167321 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c22a4606-5a03-4cf2-b72d-3cfd64928187 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:57.284777 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1d47921b-da53-47fe-bdff-4e540d3d8791 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:57.285540 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1d47921b-da53-47fe-bdff-4e540d3d8791 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:57.293877 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1d47921b-da53-47fe-bdff-4e540d3d8791 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:57.294312 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1d47921b-da53-47fe-bdff-4e540d3d8791 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:57.295405 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1d47921b-da53-47fe-bdff-4e540d3d8791 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:57.295833 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1d47921b-da53-47fe-bdff-4e540d3d8791 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:57.319653 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c22a4606-5a03-4cf2-b72d-3cfd64928187 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:57.322429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1d47921b-da53-47fe-bdff-4e540d3d8791 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Going to try to terminate instance {{(pid=116099) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:29:57.327591 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c22a4606-5a03-4cf2-b72d-3cfd64928187 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1505 microversion: 2.1 time: 0.175290 Nov 12 02:29:57.328154 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 348/721] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:57 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:29:57.410122 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1d47921b-da53-47fe-bdff-4e540d3d8791 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 204 len: 0 microversion: 2.1 time: 0.129093 Nov 12 02:29:57.410814 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 374/722] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:29:57 2021] DELETE /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 12 02:29:57.419590 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-14dd27cc-0ccc-4eaa-92ed-79a416d72149 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:57.420355 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-14dd27cc-0ccc-4eaa-92ed-79a416d72149 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:57.426764 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14dd27cc-0ccc-4eaa-92ed-79a416d72149 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:57.427286 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14dd27cc-0ccc-4eaa-92ed-79a416d72149 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:57.428063 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14dd27cc-0ccc-4eaa-92ed-79a416d72149 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:57.428494 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14dd27cc-0ccc-4eaa-92ed-79a416d72149 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:57.561359 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-14dd27cc-0ccc-4eaa-92ed-79a416d72149 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:57.569439 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-14dd27cc-0ccc-4eaa-92ed-79a416d72149 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1513 microversion: 2.1 time: 0.153946 Nov 12 02:29:57.570071 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 349/723] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:57 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:58.345813 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-db04879f-b85d-416b-997b-22a34d4204fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:58.346500 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-db04879f-b85d-416b-997b-22a34d4204fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:58.353047 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-db04879f-b85d-416b-997b-22a34d4204fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:58.353491 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-db04879f-b85d-416b-997b-22a34d4204fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:58.354260 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-db04879f-b85d-416b-997b-22a34d4204fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:58.354710 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-db04879f-b85d-416b-997b-22a34d4204fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:58.490942 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-db04879f-b85d-416b-997b-22a34d4204fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:58.498428 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-db04879f-b85d-416b-997b-22a34d4204fe tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1505 microversion: 2.1 time: 0.156626 Nov 12 02:29:58.499031 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 375/724] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:58 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:58.586464 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dc2e0e14-fe39-49ef-9c4f-fc42e5a9d49e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:58.587120 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dc2e0e14-fe39-49ef-9c4f-fc42e5a9d49e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:58.593525 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc2e0e14-fe39-49ef-9c4f-fc42e5a9d49e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:58.594009 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc2e0e14-fe39-49ef-9c4f-fc42e5a9d49e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:58.594819 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc2e0e14-fe39-49ef-9c4f-fc42e5a9d49e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:58.595259 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc2e0e14-fe39-49ef-9c4f-fc42e5a9d49e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:58.757870 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dc2e0e14-fe39-49ef-9c4f-fc42e5a9d49e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:58.765247 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dc2e0e14-fe39-49ef-9c4f-fc42e5a9d49e tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1513 microversion: 2.1 time: 0.182444 Nov 12 02:29:58.765813 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 350/725] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:58 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:59.515426 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-35248638-9288-4f3c-98ee-1f5eeb76569a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:59.516034 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-35248638-9288-4f3c-98ee-1f5eeb76569a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:59.523241 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35248638-9288-4f3c-98ee-1f5eeb76569a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:59.523692 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35248638-9288-4f3c-98ee-1f5eeb76569a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:59.524465 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35248638-9288-4f3c-98ee-1f5eeb76569a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:59.524900 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35248638-9288-4f3c-98ee-1f5eeb76569a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:59.660958 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-35248638-9288-4f3c-98ee-1f5eeb76569a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:59.668922 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-35248638-9288-4f3c-98ee-1f5eeb76569a tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1505 microversion: 2.1 time: 0.157165 Nov 12 02:29:59.669495 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 376/726] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:59 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:29:59.783449 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4f02b787-2fca-468e-aee7-45bb77c78939 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:29:59.784040 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4f02b787-2fca-468e-aee7-45bb77c78939 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:59.790468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4f02b787-2fca-468e-aee7-45bb77c78939 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:59.791036 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4f02b787-2fca-468e-aee7-45bb77c78939 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:59.791823 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4f02b787-2fca-468e-aee7-45bb77c78939 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:59.792256 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4f02b787-2fca-468e-aee7-45bb77c78939 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:59.854631 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-aa5373b0-4663-4864-8d69-5a2701bc0bce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:29:59.855400 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-aa5373b0-4663-4864-8d69-5a2701bc0bce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:29:59.861278 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aa5373b0-4663-4864-8d69-5a2701bc0bce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:59.861734 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aa5373b0-4663-4864-8d69-5a2701bc0bce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:59.862525 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aa5373b0-4663-4864-8d69-5a2701bc0bce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:29:59.863004 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aa5373b0-4663-4864-8d69-5a2701bc0bce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:29:59.887585 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-aa5373b0-4663-4864-8d69-5a2701bc0bce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lazy-loading 'flavor' on Instance uuid 26d16c68-a04c-4a32-a599-e202e6c64152 {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:29:59.927735 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4f02b787-2fca-468e-aee7-45bb77c78939 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:29:59.935319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4f02b787-2fca-468e-aee7-45bb77c78939 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1513 microversion: 2.1 time: 0.155506 Nov 12 02:29:59.935898 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 351/727] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:29:59 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:30:00.049254 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-92258fbb-be7e-483d-b677-bd6550d4081c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "783f9c4f-7300-4a92-9cf5-742c0f50665e"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:30:00.050372 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-92258fbb-be7e-483d-b677-bd6550d4081c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:00.057472 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-92258fbb-be7e-483d-b677-bd6550d4081c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:00.057754 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-92258fbb-be7e-483d-b677-bd6550d4081c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:00.058583 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-92258fbb-be7e-483d-b677-bd6550d4081c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:00.059049 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-92258fbb-be7e-483d-b677-bd6550d4081c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:00.194253 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-aa5373b0-4663-4864-8d69-5a2701bc0bce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 202 len: 0 microversion: 2.20 time: 0.343295 Nov 12 02:30:00.195480 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 377/728] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:29:59 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 12 02:30:00.203971 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-bec65178-9433-45c7-81cc-e0b5c5eaaca6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:00.204665 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-bec65178-9433-45c7-81cc-e0b5c5eaaca6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:00.210950 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bec65178-9433-45c7-81cc-e0b5c5eaaca6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:00.211400 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bec65178-9433-45c7-81cc-e0b5c5eaaca6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:00.212177 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bec65178-9433-45c7-81cc-e0b5c5eaaca6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:00.212616 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bec65178-9433-45c7-81cc-e0b5c5eaaca6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:00.381656 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-bec65178-9433-45c7-81cc-e0b5c5eaaca6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:00.390973 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-bec65178-9433-45c7-81cc-e0b5c5eaaca6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:00.392503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-bec65178-9433-45c7-81cc-e0b5c5eaaca6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:00.393665 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-bec65178-9433-45c7-81cc-e0b5c5eaaca6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.193646 Nov 12 02:30:00.394234 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 378/729] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:00 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:30:00.547214 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-92258fbb-be7e-483d-b677-bd6550d4081c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501956 Nov 12 02:30:00.547851 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 352/730] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:30:00 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:30:00.684894 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c6a8f231-f47d-44bf-99c1-69621136e9d2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:00.685481 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c6a8f231-f47d-44bf-99c1-69621136e9d2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:00.691338 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c6a8f231-f47d-44bf-99c1-69621136e9d2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:00.691774 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c6a8f231-f47d-44bf-99c1-69621136e9d2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:00.692602 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c6a8f231-f47d-44bf-99c1-69621136e9d2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:00.693025 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c6a8f231-f47d-44bf-99c1-69621136e9d2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:00.850952 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c6a8f231-f47d-44bf-99c1-69621136e9d2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:00.858520 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c6a8f231-f47d-44bf-99c1-69621136e9d2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1505 microversion: 2.1 time: 0.177086 Nov 12 02:30:00.859117 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 379/731] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:00 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:00.922334 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-db99bdbf-958b-44ab-a381-2b290c13267c req-533e59a7-40c3-45eb-a46d-e94b401fbecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77f715d-8c97-4b1e-97e6-bc2113bcfdda", "name": "network-vif-deleted", "tag": "7f000e01-26cd-44b1-8553-819556797aa2"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:30:00.924256 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:30:00.924256 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:30:00.932924 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-db99bdbf-958b-44ab-a381-2b290c13267c req-533e59a7-40c3-45eb-a46d-e94b401fbecc service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:00.933375 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-db99bdbf-958b-44ab-a381-2b290c13267c req-533e59a7-40c3-45eb-a46d-e94b401fbecc service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:00.946454 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-db99bdbf-958b-44ab-a381-2b290c13267c req-533e59a7-40c3-45eb-a46d-e94b401fbecc service nova] Creating event network-vif-deleted:7f000e01-26cd-44b1-8553-819556797aa2 for instance f77f715d-8c97-4b1e-97e6-bc2113bcfdda on hv-cinder-80857 Nov 12 02:30:00.955229 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9c3eff19-e44f-4e6f-94fc-9e8440c0855b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:00.956297 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9c3eff19-e44f-4e6f-94fc-9e8440c0855b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:00.963187 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9c3eff19-e44f-4e6f-94fc-9e8440c0855b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:00.963958 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9c3eff19-e44f-4e6f-94fc-9e8440c0855b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:00.964132 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-db99bdbf-958b-44ab-a381-2b290c13267c req-533e59a7-40c3-45eb-a46d-e94b401fbecc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047848 Nov 12 02:30:00.964703 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 353/732] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:30:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:30:00.967432 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9c3eff19-e44f-4e6f-94fc-9e8440c0855b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:00.968304 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9c3eff19-e44f-4e6f-94fc-9e8440c0855b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:01.048432 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9c3eff19-e44f-4e6f-94fc-9e8440c0855b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:01.056944 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9c3eff19-e44f-4e6f-94fc-9e8440c0855b tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 200 len: 1302 microversion: 2.1 time: 0.106180 Nov 12 02:30:01.057560 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 380/733] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:00 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 1302 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:30:01.415929 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3964fcc6-e2bd-49a2-98bd-7bb37858ef8d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:01.416551 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3964fcc6-e2bd-49a2-98bd-7bb37858ef8d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:01.424499 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3964fcc6-e2bd-49a2-98bd-7bb37858ef8d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:01.424948 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3964fcc6-e2bd-49a2-98bd-7bb37858ef8d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:01.426241 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3964fcc6-e2bd-49a2-98bd-7bb37858ef8d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:01.426700 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3964fcc6-e2bd-49a2-98bd-7bb37858ef8d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:01.578831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3964fcc6-e2bd-49a2-98bd-7bb37858ef8d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:01.591338 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3964fcc6-e2bd-49a2-98bd-7bb37858ef8d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:01.594919 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3964fcc6-e2bd-49a2-98bd-7bb37858ef8d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:01.596458 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3964fcc6-e2bd-49a2-98bd-7bb37858ef8d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.186959 Nov 12 02:30:01.597072 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 354/734] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:01 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:30:01.877222 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-191a9fed-bd66-4c9b-8cda-e77a88da9e13 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:01.877967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-191a9fed-bd66-4c9b-8cda-e77a88da9e13 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:01.886131 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-191a9fed-bd66-4c9b-8cda-e77a88da9e13 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:01.886584 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-191a9fed-bd66-4c9b-8cda-e77a88da9e13 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:01.887427 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-191a9fed-bd66-4c9b-8cda-e77a88da9e13 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:01.888054 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-191a9fed-bd66-4c9b-8cda-e77a88da9e13 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:01.920532 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-191a9fed-bd66-4c9b-8cda-e77a88da9e13 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:01.920983 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-191a9fed-bd66-4c9b-8cda-e77a88da9e13 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:01.921435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-191a9fed-bd66-4c9b-8cda-e77a88da9e13 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lazy-loading 'fault' on Instance uuid 701cf4eb-6d33-4aa4-a762-2cae743dd618 {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:30:01.970205 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-191a9fed-bd66-4c9b-8cda-e77a88da9e13 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:01.977669 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-191a9fed-bd66-4c9b-8cda-e77a88da9e13 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 200 len: 1311 microversion: 2.1 time: 0.104163 Nov 12 02:30:01.978233 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 381/735] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:01 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:02.074096 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1e196db2-24a3-4c70-80c9-86321dfc2924 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:02.074800 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1e196db2-24a3-4c70-80c9-86321dfc2924 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: f77f715d-8c97-4b1e-97e6-bc2113bcfdda] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:02.081155 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e196db2-24a3-4c70-80c9-86321dfc2924 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:02.081608 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e196db2-24a3-4c70-80c9-86321dfc2924 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:02.082396 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e196db2-24a3-4c70-80c9-86321dfc2924 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:02.082865 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1e196db2-24a3-4c70-80c9-86321dfc2924 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:02.096583 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-1e196db2-24a3-4c70-80c9-86321dfc2924 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] HTTP exception thrown: Instance f77f715d-8c97-4b1e-97e6-bc2113bcfdda could not be found. Nov 12 02:30:02.097198 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1e196db2-24a3-4c70-80c9-86321dfc2924 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Returning 404 to user: Instance f77f715d-8c97-4b1e-97e6-bc2113bcfdda could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:30:02.098010 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1e196db2-24a3-4c70-80c9-86321dfc2924 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda" status: 404 len: 111 microversion: 2.1 time: 0.027792 Nov 12 02:30:02.098546 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 355/736] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:02 2021] GET /compute/v2.1/servers/f77f715d-8c97-4b1e-97e6-bc2113bcfdda => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:30:02.620993 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6e717af0-51a4-4ec4-8557-6f58f5490d83 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:02.622282 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6e717af0-51a4-4ec4-8557-6f58f5490d83 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:02.632632 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6e717af0-51a4-4ec4-8557-6f58f5490d83 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:02.633346 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6e717af0-51a4-4ec4-8557-6f58f5490d83 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:02.634143 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6e717af0-51a4-4ec4-8557-6f58f5490d83 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:02.634614 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6e717af0-51a4-4ec4-8557-6f58f5490d83 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:02.791565 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6e717af0-51a4-4ec4-8557-6f58f5490d83 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:02.799543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6e717af0-51a4-4ec4-8557-6f58f5490d83 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:02.801603 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6e717af0-51a4-4ec4-8557-6f58f5490d83 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:02.803536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6e717af0-51a4-4ec4-8557-6f58f5490d83 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.190820 Nov 12 02:30:02.804473 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 382/737] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:02 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:02.979340 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-3a4d3b40-3cad-4e55-bb1c-2a61cab8b230 req-40ff538d-1c88-4935-beac-0476c18127e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701cf4eb-6d33-4aa4-a762-2cae743dd618", "name": "network-vif-deleted", "tag": "b7a3e8e1-ad9e-43fd-945c-a4294eb6d9b9"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:30:02.980980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:30:02.980980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:30:02.988001 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-3a4d3b40-3cad-4e55-bb1c-2a61cab8b230 req-40ff538d-1c88-4935-beac-0476c18127e3 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:02.989140 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-3a4d3b40-3cad-4e55-bb1c-2a61cab8b230 req-40ff538d-1c88-4935-beac-0476c18127e3 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:02.994568 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a2084b6f-d555-4f68-a618-6cfece324ecb tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:02.995223 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a2084b6f-d555-4f68-a618-6cfece324ecb tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 701cf4eb-6d33-4aa4-a762-2cae743dd618] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:03.000478 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-3a4d3b40-3cad-4e55-bb1c-2a61cab8b230 req-40ff538d-1c88-4935-beac-0476c18127e3 service nova] Creating event network-vif-deleted:b7a3e8e1-ad9e-43fd-945c-a4294eb6d9b9 for instance 701cf4eb-6d33-4aa4-a762-2cae743dd618 on hv-cinder-80857 Nov 12 02:30:03.001470 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a2084b6f-d555-4f68-a618-6cfece324ecb tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:03.001914 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a2084b6f-d555-4f68-a618-6cfece324ecb tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:03.002698 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a2084b6f-d555-4f68-a618-6cfece324ecb tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:03.003131 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a2084b6f-d555-4f68-a618-6cfece324ecb tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:03.005857 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-3a4d3b40-3cad-4e55-bb1c-2a61cab8b230 req-40ff538d-1c88-4935-beac-0476c18127e3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030469 Nov 12 02:30:03.006444 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 356/738] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:30:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:30:03.017846 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-a2084b6f-d555-4f68-a618-6cfece324ecb tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] HTTP exception thrown: Instance 701cf4eb-6d33-4aa4-a762-2cae743dd618 could not be found. Nov 12 02:30:03.018430 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a2084b6f-d555-4f68-a618-6cfece324ecb tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Returning 404 to user: Instance 701cf4eb-6d33-4aa4-a762-2cae743dd618 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:30:03.019283 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a2084b6f-d555-4f68-a618-6cfece324ecb tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618" status: 404 len: 111 microversion: 2.1 time: 0.028660 Nov 12 02:30:03.019812 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 383/739] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:02 2021] GET /compute/v2.1/servers/701cf4eb-6d33-4aa4-a762-2cae743dd618 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 12 02:30:03.028092 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d155bf27-c3d3-4b51-b23d-3e30ce0ad8c8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:03.028665 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d155bf27-c3d3-4b51-b23d-3e30ce0ad8c8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:03.034768 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d155bf27-c3d3-4b51-b23d-3e30ce0ad8c8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:03.035222 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d155bf27-c3d3-4b51-b23d-3e30ce0ad8c8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:03.036021 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d155bf27-c3d3-4b51-b23d-3e30ce0ad8c8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:03.036459 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d155bf27-c3d3-4b51-b23d-3e30ce0ad8c8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:03.061317 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d155bf27-c3d3-4b51-b23d-3e30ce0ad8c8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:30:03.144987 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d155bf27-c3d3-4b51-b23d-3e30ce0ad8c8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "DELETE /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 204 len: 0 microversion: 2.1 time: 0.120494 Nov 12 02:30:03.145599 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 357/740] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:30:03 2021] DELETE /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:30:03.153240 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-de88c925-5585-4505-8430-d9ca31041bdf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:03.153961 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-de88c925-5585-4505-8430-d9ca31041bdf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:03.160067 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-de88c925-5585-4505-8430-d9ca31041bdf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:03.160596 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-de88c925-5585-4505-8430-d9ca31041bdf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:03.161381 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-de88c925-5585-4505-8430-d9ca31041bdf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:03.161820 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-de88c925-5585-4505-8430-d9ca31041bdf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:03.239603 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ffc415fd-007e-4923-8ec3-875c9d681b93 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:03.240217 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ffc415fd-007e-4923-8ec3-875c9d681b93 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:03.247089 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ffc415fd-007e-4923-8ec3-875c9d681b93 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:03.247575 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ffc415fd-007e-4923-8ec3-875c9d681b93 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:03.248500 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ffc415fd-007e-4923-8ec3-875c9d681b93 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:03.248946 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ffc415fd-007e-4923-8ec3-875c9d681b93 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:03.277347 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ffc415fd-007e-4923-8ec3-875c9d681b93 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:30:03.296293 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-de88c925-5585-4505-8430-d9ca31041bdf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:03.303551 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-de88c925-5585-4505-8430-d9ca31041bdf tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.153985 Nov 12 02:30:03.304124 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 384/741] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:03 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:03.353742 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ffc415fd-007e-4923-8ec3-875c9d681b93 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 204 len: 0 microversion: 2.1 time: 0.118354 Nov 12 02:30:03.354615 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 358/742] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:30:03 2021] DELETE /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 12 02:30:03.362043 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-175afdf4-421d-481c-a904-9d7fe6806af8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:03.362651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-175afdf4-421d-481c-a904-9d7fe6806af8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:03.368853 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-175afdf4-421d-481c-a904-9d7fe6806af8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:03.369303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-175afdf4-421d-481c-a904-9d7fe6806af8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:03.370088 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-175afdf4-421d-481c-a904-9d7fe6806af8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:03.370526 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-175afdf4-421d-481c-a904-9d7fe6806af8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:03.503452 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-175afdf4-421d-481c-a904-9d7fe6806af8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:03.511481 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-175afdf4-421d-481c-a904-9d7fe6806af8 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1514 microversion: 2.1 time: 0.153082 Nov 12 02:30:03.512044 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 385/743] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:03 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:03.857884 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cf9d21c0-f267-4c19-b533-c857bf5f813d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:03.858762 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cf9d21c0-f267-4c19-b533-c857bf5f813d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:03.865156 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf9d21c0-f267-4c19-b533-c857bf5f813d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:03.865612 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf9d21c0-f267-4c19-b533-c857bf5f813d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:03.866534 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf9d21c0-f267-4c19-b533-c857bf5f813d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:03.866997 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf9d21c0-f267-4c19-b533-c857bf5f813d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:04.010511 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cf9d21c0-f267-4c19-b533-c857bf5f813d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:04.018418 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cf9d21c0-f267-4c19-b533-c857bf5f813d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:04.019949 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cf9d21c0-f267-4c19-b533-c857bf5f813d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:04.021092 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cf9d21c0-f267-4c19-b533-c857bf5f813d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.167470 Nov 12 02:30:04.021647 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 359/744] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:03 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:04.320695 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8aaaf669-dd48-450f-8622-306f4e07996d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:04.321316 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8aaaf669-dd48-450f-8622-306f4e07996d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:04.327686 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8aaaf669-dd48-450f-8622-306f4e07996d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:04.328133 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8aaaf669-dd48-450f-8622-306f4e07996d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:04.328902 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8aaaf669-dd48-450f-8622-306f4e07996d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:04.329336 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8aaaf669-dd48-450f-8622-306f4e07996d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:04.468895 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8aaaf669-dd48-450f-8622-306f4e07996d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:04.478198 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8aaaf669-dd48-450f-8622-306f4e07996d tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.161355 Nov 12 02:30:04.478804 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 386/745] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:04 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:04.529015 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0ccf6f0a-2272-4a5a-ac49-1bd85128612d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:04.529626 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0ccf6f0a-2272-4a5a-ac49-1bd85128612d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:04.536529 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ccf6f0a-2272-4a5a-ac49-1bd85128612d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:04.536975 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ccf6f0a-2272-4a5a-ac49-1bd85128612d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:04.537748 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ccf6f0a-2272-4a5a-ac49-1bd85128612d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:04.538195 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ccf6f0a-2272-4a5a-ac49-1bd85128612d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:04.682889 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0ccf6f0a-2272-4a5a-ac49-1bd85128612d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:04.701029 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0ccf6f0a-2272-4a5a-ac49-1bd85128612d tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1514 microversion: 2.1 time: 0.175380 Nov 12 02:30:04.701831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 360/746] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:04 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:05.039926 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d15399c7-4aa4-4643-9ca9-fac0415fc8df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:05.040445 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d15399c7-4aa4-4643-9ca9-fac0415fc8df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:05.046266 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d15399c7-4aa4-4643-9ca9-fac0415fc8df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:05.046745 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d15399c7-4aa4-4643-9ca9-fac0415fc8df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:05.047521 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d15399c7-4aa4-4643-9ca9-fac0415fc8df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:05.047961 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d15399c7-4aa4-4643-9ca9-fac0415fc8df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:05.177761 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d15399c7-4aa4-4643-9ca9-fac0415fc8df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:05.185690 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d15399c7-4aa4-4643-9ca9-fac0415fc8df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:05.187228 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d15399c7-4aa4-4643-9ca9-fac0415fc8df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:05.188495 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d15399c7-4aa4-4643-9ca9-fac0415fc8df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.152583 Nov 12 02:30:05.189057 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 387/747] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:05 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:05.496025 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-799a05c5-5e93-4987-b920-6441d97f845e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:05.496850 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-799a05c5-5e93-4987-b920-6441d97f845e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:05.502569 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-799a05c5-5e93-4987-b920-6441d97f845e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:05.503046 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-799a05c5-5e93-4987-b920-6441d97f845e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:05.503954 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-799a05c5-5e93-4987-b920-6441d97f845e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:05.504268 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-799a05c5-5e93-4987-b920-6441d97f845e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:05.645127 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-799a05c5-5e93-4987-b920-6441d97f845e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:05.652950 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-799a05c5-5e93-4987-b920-6441d97f845e tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.161073 Nov 12 02:30:05.653520 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 361/748] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:05 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:05.725739 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ff4ff045-fdbf-429c-b571-6eefd0756231 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:05.726327 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ff4ff045-fdbf-429c-b571-6eefd0756231 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:05.732616 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ff4ff045-fdbf-429c-b571-6eefd0756231 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:05.733057 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ff4ff045-fdbf-429c-b571-6eefd0756231 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:05.733844 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ff4ff045-fdbf-429c-b571-6eefd0756231 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:05.734275 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ff4ff045-fdbf-429c-b571-6eefd0756231 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:05.870998 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ff4ff045-fdbf-429c-b571-6eefd0756231 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:05.880219 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ff4ff045-fdbf-429c-b571-6eefd0756231 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1514 microversion: 2.1 time: 0.158669 Nov 12 02:30:05.880795 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 388/749] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:05 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:06.207361 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f2ff7067-c099-4f71-8121-68f70774d909 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:06.208011 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f2ff7067-c099-4f71-8121-68f70774d909 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:06.213799 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2ff7067-c099-4f71-8121-68f70774d909 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:06.214243 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2ff7067-c099-4f71-8121-68f70774d909 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:06.215045 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2ff7067-c099-4f71-8121-68f70774d909 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:06.215482 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2ff7067-c099-4f71-8121-68f70774d909 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:06.361009 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f2ff7067-c099-4f71-8121-68f70774d909 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:06.367815 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-6eeadcfb-aa7c-497e-a2f8-563eccff19be req-f0c69536-a647-4fa8-bd49-e80961a95d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1199c966-c222-4f06-8d6c-80d247db4c5a", "name": "network-vif-deleted", "tag": "8e3501f5-92b1-4fb2-87a9-3b8de8e25091"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:30:06.370192 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:30:06.370192 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:30:06.371772 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f2ff7067-c099-4f71-8121-68f70774d909 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:06.373298 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f2ff7067-c099-4f71-8121-68f70774d909 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:06.374504 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f2ff7067-c099-4f71-8121-68f70774d909 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.170880 Nov 12 02:30:06.375321 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 362/750] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:06 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:06.378112 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-6eeadcfb-aa7c-497e-a2f8-563eccff19be req-f0c69536-a647-4fa8-bd49-e80961a95d15 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:06.378692 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-6eeadcfb-aa7c-497e-a2f8-563eccff19be req-f0c69536-a647-4fa8-bd49-e80961a95d15 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:06.403059 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-6eeadcfb-aa7c-497e-a2f8-563eccff19be req-f0c69536-a647-4fa8-bd49-e80961a95d15 service nova] Creating event network-vif-deleted:8e3501f5-92b1-4fb2-87a9-3b8de8e25091 for instance 1199c966-c222-4f06-8d6c-80d247db4c5a on hv-cinder-80857 Nov 12 02:30:06.408842 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-6eeadcfb-aa7c-497e-a2f8-563eccff19be req-f0c69536-a647-4fa8-bd49-e80961a95d15 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047482 Nov 12 02:30:06.409445 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 389/751] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:30:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:30:06.671257 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-23742c58-6d01-4d64-aae6-19c943cda3b8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:06.671780 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-23742c58-6d01-4d64-aae6-19c943cda3b8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:06.678077 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23742c58-6d01-4d64-aae6-19c943cda3b8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:06.678567 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23742c58-6d01-4d64-aae6-19c943cda3b8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:06.681634 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23742c58-6d01-4d64-aae6-19c943cda3b8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:06.682855 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23742c58-6d01-4d64-aae6-19c943cda3b8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:06.821088 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-23742c58-6d01-4d64-aae6-19c943cda3b8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:06.828247 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-23742c58-6d01-4d64-aae6-19c943cda3b8 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.160793 Nov 12 02:30:06.828803 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 363/752] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:06 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:06.897957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7b05b623-c7dc-4938-b13f-c3a8632af895 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:06.898648 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7b05b623-c7dc-4938-b13f-c3a8632af895 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:06.905139 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b05b623-c7dc-4938-b13f-c3a8632af895 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:06.905587 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b05b623-c7dc-4938-b13f-c3a8632af895 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:06.906351 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b05b623-c7dc-4938-b13f-c3a8632af895 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:06.906813 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b05b623-c7dc-4938-b13f-c3a8632af895 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:06.936310 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b05b623-c7dc-4938-b13f-c3a8632af895 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:06.936661 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b05b623-c7dc-4938-b13f-c3a8632af895 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:06.937109 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-7b05b623-c7dc-4938-b13f-c3a8632af895 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lazy-loading 'fault' on Instance uuid 1199c966-c222-4f06-8d6c-80d247db4c5a {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:30:06.976736 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7b05b623-c7dc-4938-b13f-c3a8632af895 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:06.984068 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7b05b623-c7dc-4938-b13f-c3a8632af895 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 200 len: 1308 microversion: 2.1 time: 0.090628 Nov 12 02:30:06.984652 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 390/753] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:06 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:07.393292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-61e2b45a-2b71-4a0d-b5a5-5a513a8b70d8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:07.395063 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-61e2b45a-2b71-4a0d-b5a5-5a513a8b70d8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:07.401891 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61e2b45a-2b71-4a0d-b5a5-5a513a8b70d8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:07.402330 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61e2b45a-2b71-4a0d-b5a5-5a513a8b70d8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:07.403295 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61e2b45a-2b71-4a0d-b5a5-5a513a8b70d8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:07.404057 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61e2b45a-2b71-4a0d-b5a5-5a513a8b70d8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:07.540757 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-61e2b45a-2b71-4a0d-b5a5-5a513a8b70d8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:07.548264 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-61e2b45a-2b71-4a0d-b5a5-5a513a8b70d8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:07.549741 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-61e2b45a-2b71-4a0d-b5a5-5a513a8b70d8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:07.551023 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-61e2b45a-2b71-4a0d-b5a5-5a513a8b70d8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.161901 Nov 12 02:30:07.551571 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 364/754] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:07 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:07.846463 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-dca94719-b3e3-4e7e-a82e-ebb5cbdfbd99 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:07.847102 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-dca94719-b3e3-4e7e-a82e-ebb5cbdfbd99 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:07.853552 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dca94719-b3e3-4e7e-a82e-ebb5cbdfbd99 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:07.854001 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dca94719-b3e3-4e7e-a82e-ebb5cbdfbd99 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:07.854874 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dca94719-b3e3-4e7e-a82e-ebb5cbdfbd99 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:07.855313 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dca94719-b3e3-4e7e-a82e-ebb5cbdfbd99 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:07.984951 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-dca94719-b3e3-4e7e-a82e-ebb5cbdfbd99 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:07.993050 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-dca94719-b3e3-4e7e-a82e-ebb5cbdfbd99 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.149960 Nov 12 02:30:07.993619 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 391/755] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:07 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:08.001288 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8464ee6b-38a4-4204-9bb1-e6b734eb5691 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:08.001911 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8464ee6b-38a4-4204-9bb1-e6b734eb5691 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 1199c966-c222-4f06-8d6c-80d247db4c5a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:08.009985 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8464ee6b-38a4-4204-9bb1-e6b734eb5691 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:08.010909 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8464ee6b-38a4-4204-9bb1-e6b734eb5691 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:08.012350 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8464ee6b-38a4-4204-9bb1-e6b734eb5691 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:08.013174 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8464ee6b-38a4-4204-9bb1-e6b734eb5691 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:08.038101 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-8464ee6b-38a4-4204-9bb1-e6b734eb5691 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] HTTP exception thrown: Instance 1199c966-c222-4f06-8d6c-80d247db4c5a could not be found. Nov 12 02:30:08.039228 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8464ee6b-38a4-4204-9bb1-e6b734eb5691 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Returning 404 to user: Instance 1199c966-c222-4f06-8d6c-80d247db4c5a could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:30:08.040787 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8464ee6b-38a4-4204-9bb1-e6b734eb5691 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a" status: 404 len: 111 microversion: 2.1 time: 0.043106 Nov 12 02:30:08.041791 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 365/756] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:07 2021] GET /compute/v2.1/servers/1199c966-c222-4f06-8d6c-80d247db4c5a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:30:08.049545 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-98313230-bf5b-4a2a-acce-50736c93bb8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:08.050036 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-98313230-bf5b-4a2a-acce-50736c93bb8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:08.056527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-98313230-bf5b-4a2a-acce-50736c93bb8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:08.056964 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-98313230-bf5b-4a2a-acce-50736c93bb8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:08.057724 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-98313230-bf5b-4a2a-acce-50736c93bb8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:08.058154 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-98313230-bf5b-4a2a-acce-50736c93bb8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:08.081600 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-98313230-bf5b-4a2a-acce-50736c93bb8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Going to try to terminate instance {{(pid=116099) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:30:08.109078 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-28dd29b3-5de7-42ce-a244-604787e5bb44 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:30:08.115380 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28dd29b3-5de7-42ce-a244-604787e5bb44 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:08.115832 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28dd29b3-5de7-42ce-a244-604787e5bb44 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:08.157254 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-98313230-bf5b-4a2a-acce-50736c93bb8a tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 204 len: 0 microversion: 2.1 time: 0.111036 Nov 12 02:30:08.157867 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 392/757] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:30:08 2021] DELETE /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:30:08.167052 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3d4ff7e3-8798-4316-9aa1-a625d400dcf9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:08.167744 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3d4ff7e3-8798-4316-9aa1-a625d400dcf9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:08.173299 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d4ff7e3-8798-4316-9aa1-a625d400dcf9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:08.173749 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d4ff7e3-8798-4316-9aa1-a625d400dcf9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:08.174515 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d4ff7e3-8798-4316-9aa1-a625d400dcf9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:08.174977 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d4ff7e3-8798-4316-9aa1-a625d400dcf9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:08.177037 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-28dd29b3-5de7-42ce-a244-604787e5bb44 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Going to try to stop instance {{(pid=116098) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 12 02:30:08.220414 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-28dd29b3-5de7-42ce-a244-604787e5bb44 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 202 len: 0 microversion: 2.1 time: 0.114899 Nov 12 02:30:08.220997 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 366/758] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:30:08 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:30:08.229093 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d5071703-1eb4-43b8-a5e4-b611f83c4561 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:08.229790 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d5071703-1eb4-43b8-a5e4-b611f83c4561 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:08.236159 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d5071703-1eb4-43b8-a5e4-b611f83c4561 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:08.236534 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d5071703-1eb4-43b8-a5e4-b611f83c4561 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:08.237316 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d5071703-1eb4-43b8-a5e4-b611f83c4561 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:08.237826 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d5071703-1eb4-43b8-a5e4-b611f83c4561 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:08.558929 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3d4ff7e3-8798-4316-9aa1-a625d400dcf9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:08.566536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3d4ff7e3-8798-4316-9aa1-a625d400dcf9 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1513 microversion: 2.1 time: 0.403537 Nov 12 02:30:08.567332 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 393/759] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:08 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1513 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:30:08.571378 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-39b8800e-9c60-4e3c-9d9d-a05ec46deaa0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:08.571976 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-39b8800e-9c60-4e3c-9d9d-a05ec46deaa0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:08.578102 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-39b8800e-9c60-4e3c-9d9d-a05ec46deaa0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:08.578539 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-39b8800e-9c60-4e3c-9d9d-a05ec46deaa0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:08.579386 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-39b8800e-9c60-4e3c-9d9d-a05ec46deaa0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:08.579817 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-39b8800e-9c60-4e3c-9d9d-a05ec46deaa0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:08.627424 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d5071703-1eb4-43b8-a5e4-b611f83c4561 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:08.636086 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d5071703-1eb4-43b8-a5e4-b611f83c4561 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1720 microversion: 2.1 time: 0.410683 Nov 12 02:30:08.636838 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 367/760] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:08 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1720 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:30:08.711562 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-39b8800e-9c60-4e3c-9d9d-a05ec46deaa0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:08.719146 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-39b8800e-9c60-4e3c-9d9d-a05ec46deaa0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:08.720629 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-39b8800e-9c60-4e3c-9d9d-a05ec46deaa0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:08.721768 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-39b8800e-9c60-4e3c-9d9d-a05ec46deaa0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.153707 Nov 12 02:30:08.722863 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 394/761] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:08 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:09.010596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b4cce0ea-75da-40ee-8bcf-55c472ddd3ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:09.011255 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b4cce0ea-75da-40ee-8bcf-55c472ddd3ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:09.017672 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4cce0ea-75da-40ee-8bcf-55c472ddd3ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:09.018119 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4cce0ea-75da-40ee-8bcf-55c472ddd3ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:09.018940 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4cce0ea-75da-40ee-8bcf-55c472ddd3ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:09.019437 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4cce0ea-75da-40ee-8bcf-55c472ddd3ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:09.163657 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b4cce0ea-75da-40ee-8bcf-55c472ddd3ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:09.170990 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b4cce0ea-75da-40ee-8bcf-55c472ddd3ba tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.165016 Nov 12 02:30:09.171537 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 368/762] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:09 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:09.583530 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e693638d-9c25-44a7-8817-cc4e375e7235 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:09.584127 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e693638d-9c25-44a7-8817-cc4e375e7235 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:09.590431 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e693638d-9c25-44a7-8817-cc4e375e7235 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:09.590918 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e693638d-9c25-44a7-8817-cc4e375e7235 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:09.591698 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e693638d-9c25-44a7-8817-cc4e375e7235 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:09.592132 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e693638d-9c25-44a7-8817-cc4e375e7235 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:09.653936 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-adf4f216-0e42-4494-9826-a3359e92182c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:09.654551 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-adf4f216-0e42-4494-9826-a3359e92182c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:09.661164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-adf4f216-0e42-4494-9826-a3359e92182c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:09.661164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-adf4f216-0e42-4494-9826-a3359e92182c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:09.661718 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-adf4f216-0e42-4494-9826-a3359e92182c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:09.662152 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-adf4f216-0e42-4494-9826-a3359e92182c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:09.757042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e693638d-9c25-44a7-8817-cc4e375e7235 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:09.764283 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e693638d-9c25-44a7-8817-cc4e375e7235 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1513 microversion: 2.1 time: 0.184517 Nov 12 02:30:09.764860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 395/763] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:09 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:09.769084 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a954626d-d58b-43b6-8529-8b2fcb63bb13 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:09.769688 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a954626d-d58b-43b6-8529-8b2fcb63bb13 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:09.775580 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a954626d-d58b-43b6-8529-8b2fcb63bb13 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:09.776032 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a954626d-d58b-43b6-8529-8b2fcb63bb13 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:09.776819 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a954626d-d58b-43b6-8529-8b2fcb63bb13 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:09.777257 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a954626d-d58b-43b6-8529-8b2fcb63bb13 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:09.832057 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-adf4f216-0e42-4494-9826-a3359e92182c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:09.840830 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-adf4f216-0e42-4494-9826-a3359e92182c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1720 microversion: 2.1 time: 0.190537 Nov 12 02:30:09.841327 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 369/764] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:09 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:30:09.918382 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a954626d-d58b-43b6-8529-8b2fcb63bb13 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:09.926555 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a954626d-d58b-43b6-8529-8b2fcb63bb13 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:09.928210 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a954626d-d58b-43b6-8529-8b2fcb63bb13 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:09.929349 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a954626d-d58b-43b6-8529-8b2fcb63bb13 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.163582 Nov 12 02:30:09.929902 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 396/765] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:09 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:10.188452 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b5f740a7-be47-42a7-a03c-85bfc1e538e2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:10.189062 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b5f740a7-be47-42a7-a03c-85bfc1e538e2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:10.196283 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5f740a7-be47-42a7-a03c-85bfc1e538e2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:10.196867 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5f740a7-be47-42a7-a03c-85bfc1e538e2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:10.197804 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5f740a7-be47-42a7-a03c-85bfc1e538e2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:10.198250 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5f740a7-be47-42a7-a03c-85bfc1e538e2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:10.333560 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b5f740a7-be47-42a7-a03c-85bfc1e538e2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55918cc1c2fa4eb488dcfb2942fb5edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7fcf7713f094fac83c523a879fb68ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:10.341061 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b5f740a7-be47-42a7-a03c-85bfc1e538e2 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 200 len: 1519 microversion: 2.1 time: 0.156239 Nov 12 02:30:10.341633 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 370/766] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:10 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:10.714408 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-b7abc075-2900-4931-99d8-b8df5f1f4053 req-d18533de-2087-4708-a34b-84d0fe2fcf5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c025f0-3bb5-4ce5-944f-0f553ef80f8a", "name": "network-vif-deleted", "tag": "827c9b0b-5bbb-48cc-9c27-94e0fb2378a2"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:30:10.716008 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:30:10.716008 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:30:10.729785 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-b7abc075-2900-4931-99d8-b8df5f1f4053 req-d18533de-2087-4708-a34b-84d0fe2fcf5e service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:10.730231 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-b7abc075-2900-4931-99d8-b8df5f1f4053 req-d18533de-2087-4708-a34b-84d0fe2fcf5e service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:10.751543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-b7abc075-2900-4931-99d8-b8df5f1f4053 req-d18533de-2087-4708-a34b-84d0fe2fcf5e service nova] Creating event network-vif-deleted:827c9b0b-5bbb-48cc-9c27-94e0fb2378a2 for instance 44c025f0-3bb5-4ce5-944f-0f553ef80f8a on hv-cinder-80857 Nov 12 02:30:10.756792 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-b7abc075-2900-4931-99d8-b8df5f1f4053 req-d18533de-2087-4708-a34b-84d0fe2fcf5e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045896 Nov 12 02:30:10.758421 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 397/767] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:30:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:30:10.780952 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-517e2d81-1cbd-45a3-b4ad-17d513afa7a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:10.781753 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-517e2d81-1cbd-45a3-b4ad-17d513afa7a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:10.789194 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-517e2d81-1cbd-45a3-b4ad-17d513afa7a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:10.789720 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-517e2d81-1cbd-45a3-b4ad-17d513afa7a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:10.790420 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-517e2d81-1cbd-45a3-b4ad-17d513afa7a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:10.790920 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-517e2d81-1cbd-45a3-b4ad-17d513afa7a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:10.859171 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-42ee387b-9e10-4a28-9b72-5ece19adee7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:10.860175 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-42ee387b-9e10-4a28-9b72-5ece19adee7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:10.867970 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42ee387b-9e10-4a28-9b72-5ece19adee7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:10.868425 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42ee387b-9e10-4a28-9b72-5ece19adee7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:10.869220 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42ee387b-9e10-4a28-9b72-5ece19adee7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:10.869650 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42ee387b-9e10-4a28-9b72-5ece19adee7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:11.040427 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-517e2d81-1cbd-45a3-b4ad-17d513afa7a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:11.047727 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-517e2d81-1cbd-45a3-b4ad-17d513afa7a3 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 200 len: 1513 microversion: 2.1 time: 0.271299 Nov 12 02:30:11.048304 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 371/768] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:10 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 1513 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:11.053123 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-719e0838-56d7-482f-af3b-1cfc237be8dc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:11.053728 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-719e0838-56d7-482f-af3b-1cfc237be8dc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:11.059532 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-719e0838-56d7-482f-af3b-1cfc237be8dc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:11.059981 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-719e0838-56d7-482f-af3b-1cfc237be8dc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:11.060764 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-719e0838-56d7-482f-af3b-1cfc237be8dc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:11.061196 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-719e0838-56d7-482f-af3b-1cfc237be8dc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:11.249947 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-42ee387b-9e10-4a28-9b72-5ece19adee7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:11.259953 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-42ee387b-9e10-4a28-9b72-5ece19adee7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1720 microversion: 2.1 time: 0.405652 Nov 12 02:30:11.266769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 398/769] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:10 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1720 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:30:11.273279 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-c3978bc3-b107-4d94-b1f6-a430fa1b2ad5 req-e9ca52bd-79a2-45b8-80ce-95005f35c192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b45339-7f70-45c4-9536-96f42bd1c35e", "name": "network-vif-deleted", "tag": "ebd9ab39-34d5-41c8-9ee0-e6b204c9194f"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:30:11.275503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:30:11.275503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:30:11.283294 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-c3978bc3-b107-4d94-b1f6-a430fa1b2ad5 req-e9ca52bd-79a2-45b8-80ce-95005f35c192 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:11.283822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-c3978bc3-b107-4d94-b1f6-a430fa1b2ad5 req-e9ca52bd-79a2-45b8-80ce-95005f35c192 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:11.297715 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-c3978bc3-b107-4d94-b1f6-a430fa1b2ad5 req-e9ca52bd-79a2-45b8-80ce-95005f35c192 service nova] Creating event network-vif-deleted:ebd9ab39-34d5-41c8-9ee0-e6b204c9194f for instance b1b45339-7f70-45c4-9536-96f42bd1c35e on hv-cinder-80857 Nov 12 02:30:11.303124 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-c3978bc3-b107-4d94-b1f6-a430fa1b2ad5 req-e9ca52bd-79a2-45b8-80ce-95005f35c192 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035003 Nov 12 02:30:11.304005 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 399/770] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:30:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:30:11.354690 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-719e0838-56d7-482f-af3b-1cfc237be8dc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:11.360459 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-12f54ac9-5177-4258-b5aa-d121eb4fb1b0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:11.361737 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-12f54ac9-5177-4258-b5aa-d121eb4fb1b0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] [instance: 44c025f0-3bb5-4ce5-944f-0f553ef80f8a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:11.363419 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-719e0838-56d7-482f-af3b-1cfc237be8dc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:11.365161 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-719e0838-56d7-482f-af3b-1cfc237be8dc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:11.366526 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-719e0838-56d7-482f-af3b-1cfc237be8dc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.317317 Nov 12 02:30:11.367265 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 372/771] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:11 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:11.382305 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12f54ac9-5177-4258-b5aa-d121eb4fb1b0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:11.383073 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12f54ac9-5177-4258-b5aa-d121eb4fb1b0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:11.383992 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12f54ac9-5177-4258-b5aa-d121eb4fb1b0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:11.385064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12f54ac9-5177-4258-b5aa-d121eb4fb1b0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:11.399368 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-12f54ac9-5177-4258-b5aa-d121eb4fb1b0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] HTTP exception thrown: Instance 44c025f0-3bb5-4ce5-944f-0f553ef80f8a could not be found. Nov 12 02:30:11.400028 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-12f54ac9-5177-4258-b5aa-d121eb4fb1b0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] Returning 404 to user: Instance 44c025f0-3bb5-4ce5-944f-0f553ef80f8a could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:30:11.400944 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-12f54ac9-5177-4258-b5aa-d121eb4fb1b0 tempest-ServerRescueNegativeTestJSON-677885946 tempest-ServerRescueNegativeTestJSON-677885946-project] 10.222.0.70 "GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a" status: 404 len: 111 microversion: 2.1 time: 0.046542 Nov 12 02:30:11.401495 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 400/772] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:11 2021] GET /compute/v2.1/servers/44c025f0-3bb5-4ce5-944f-0f553ef80f8a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 12 02:30:12.065501 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f6c3d28a-7452-409f-b9e8-ba077a497454 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:12.066023 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f6c3d28a-7452-409f-b9e8-ba077a497454 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: b1b45339-7f70-45c4-9536-96f42bd1c35e] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:12.071892 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f6c3d28a-7452-409f-b9e8-ba077a497454 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:12.072344 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f6c3d28a-7452-409f-b9e8-ba077a497454 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:12.073116 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f6c3d28a-7452-409f-b9e8-ba077a497454 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:12.073548 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f6c3d28a-7452-409f-b9e8-ba077a497454 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:12.087505 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-f6c3d28a-7452-409f-b9e8-ba077a497454 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] HTTP exception thrown: Instance b1b45339-7f70-45c4-9536-96f42bd1c35e could not be found. Nov 12 02:30:12.088093 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f6c3d28a-7452-409f-b9e8-ba077a497454 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Returning 404 to user: Instance b1b45339-7f70-45c4-9536-96f42bd1c35e could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:30:12.088950 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f6c3d28a-7452-409f-b9e8-ba077a497454 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e" status: 404 len: 111 microversion: 2.1 time: 0.027159 Nov 12 02:30:12.089488 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 373/773] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:12 2021] GET /compute/v2.1/servers/b1b45339-7f70-45c4-9536-96f42bd1c35e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:30:12.282174 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8a24fe8e-f7fe-45ba-93f1-86f9efef96ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:12.283489 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8a24fe8e-f7fe-45ba-93f1-86f9efef96ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:12.293994 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8a24fe8e-f7fe-45ba-93f1-86f9efef96ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:12.294819 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8a24fe8e-f7fe-45ba-93f1-86f9efef96ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:12.296161 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8a24fe8e-f7fe-45ba-93f1-86f9efef96ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:12.296933 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8a24fe8e-f7fe-45ba-93f1-86f9efef96ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:12.390475 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cb55a294-1437-4f66-8b87-12fd08e9549d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:12.391373 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cb55a294-1437-4f66-8b87-12fd08e9549d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:12.398525 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cb55a294-1437-4f66-8b87-12fd08e9549d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:12.398998 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cb55a294-1437-4f66-8b87-12fd08e9549d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:12.399775 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cb55a294-1437-4f66-8b87-12fd08e9549d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:12.400216 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cb55a294-1437-4f66-8b87-12fd08e9549d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:12.594494 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8a24fe8e-f7fe-45ba-93f1-86f9efef96ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:12.605822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8a24fe8e-f7fe-45ba-93f1-86f9efef96ab tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1720 microversion: 2.1 time: 0.330175 Nov 12 02:30:12.606544 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 401/774] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:12 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1720 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:12.728240 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cb55a294-1437-4f66-8b87-12fd08e9549d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:12.736155 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cb55a294-1437-4f66-8b87-12fd08e9549d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:12.737762 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cb55a294-1437-4f66-8b87-12fd08e9549d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:12.739379 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cb55a294-1437-4f66-8b87-12fd08e9549d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.352551 Nov 12 02:30:12.739964 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 374/775] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:12 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:30:13.261638 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-58985de5-f4a1-4033-8392-d7db75f65750 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:13.262391 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-58985de5-f4a1-4033-8392-d7db75f65750 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:13.272594 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58985de5-f4a1-4033-8392-d7db75f65750 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:13.273321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58985de5-f4a1-4033-8392-d7db75f65750 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:13.274543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58985de5-f4a1-4033-8392-d7db75f65750 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:13.275254 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58985de5-f4a1-4033-8392-d7db75f65750 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:13.321771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-58985de5-f4a1-4033-8392-d7db75f65750 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Going to try to terminate instance {{(pid=116099) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:30:13.485714 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-58985de5-f4a1-4033-8392-d7db75f65750 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 204 len: 0 microversion: 2.1 time: 0.229024 Nov 12 02:30:13.486617 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 402/776] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:30:13 2021] DELETE /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:30:13.499619 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-16209c0d-2c2f-4615-89f2-a1d017edb427 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:13.500775 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-16209c0d-2c2f-4615-89f2-a1d017edb427 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:13.513480 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-16209c0d-2c2f-4615-89f2-a1d017edb427 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:13.514710 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-16209c0d-2c2f-4615-89f2-a1d017edb427 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:13.516131 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-16209c0d-2c2f-4615-89f2-a1d017edb427 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:13.517059 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-16209c0d-2c2f-4615-89f2-a1d017edb427 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:13.629962 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-44d1bee0-6f2f-4484-b2d1-ecfbfa8ff9c5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:13.631477 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-44d1bee0-6f2f-4484-b2d1-ecfbfa8ff9c5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:13.646069 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44d1bee0-6f2f-4484-b2d1-ecfbfa8ff9c5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:13.652135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44d1bee0-6f2f-4484-b2d1-ecfbfa8ff9c5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:13.652135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44d1bee0-6f2f-4484-b2d1-ecfbfa8ff9c5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:13.652135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-44d1bee0-6f2f-4484-b2d1-ecfbfa8ff9c5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:13.931276 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-16209c0d-2c2f-4615-89f2-a1d017edb427 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:13.941035 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-16209c0d-2c2f-4615-89f2-a1d017edb427 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1515 microversion: 2.1 time: 0.448228 Nov 12 02:30:13.942319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 375/777] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:13 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1515 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:30:13.947481 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-aa3c82e0-8312-4b47-b696-39df9ae24bb5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:13.948315 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-aa3c82e0-8312-4b47-b696-39df9ae24bb5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:13.956203 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aa3c82e0-8312-4b47-b696-39df9ae24bb5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:13.957459 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aa3c82e0-8312-4b47-b696-39df9ae24bb5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:13.958279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aa3c82e0-8312-4b47-b696-39df9ae24bb5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:13.958854 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aa3c82e0-8312-4b47-b696-39df9ae24bb5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:14.002053 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-44d1bee0-6f2f-4484-b2d1-ecfbfa8ff9c5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:14.011579 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-44d1bee0-6f2f-4484-b2d1-ecfbfa8ff9c5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1720 microversion: 2.1 time: 0.390077 Nov 12 02:30:14.012434 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 403/778] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:13 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1720 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:30:14.193164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-aa3c82e0-8312-4b47-b696-39df9ae24bb5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:14.201108 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-aa3c82e0-8312-4b47-b696-39df9ae24bb5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:14.202760 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-aa3c82e0-8312-4b47-b696-39df9ae24bb5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:14.204125 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-aa3c82e0-8312-4b47-b696-39df9ae24bb5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.260644 Nov 12 02:30:14.204765 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 376/779] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:13 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:14.960528 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d98def9d-8bb2-43e4-92b4-5c5f10286e28 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:14.961459 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d98def9d-8bb2-43e4-92b4-5c5f10286e28 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:14.968264 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d98def9d-8bb2-43e4-92b4-5c5f10286e28 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:14.968722 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d98def9d-8bb2-43e4-92b4-5c5f10286e28 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:14.969527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d98def9d-8bb2-43e4-92b4-5c5f10286e28 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:14.969964 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d98def9d-8bb2-43e4-92b4-5c5f10286e28 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:15.029141 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a42fcb5a-d225-4026-82db-141a2bcf5707 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:15.029750 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a42fcb5a-d225-4026-82db-141a2bcf5707 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:15.036878 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a42fcb5a-d225-4026-82db-141a2bcf5707 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:15.037340 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a42fcb5a-d225-4026-82db-141a2bcf5707 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:15.038135 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a42fcb5a-d225-4026-82db-141a2bcf5707 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:15.038571 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a42fcb5a-d225-4026-82db-141a2bcf5707 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:15.355892 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d98def9d-8bb2-43e4-92b4-5c5f10286e28 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:15.366583 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d98def9d-8bb2-43e4-92b4-5c5f10286e28 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1515 microversion: 2.1 time: 0.409643 Nov 12 02:30:15.367967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 404/780] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:14 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1515 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:15.374308 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-93273ca5-9fbc-47a4-91e6-9e8d8fb19eee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:15.375241 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-93273ca5-9fbc-47a4-91e6-9e8d8fb19eee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:15.392302 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-93273ca5-9fbc-47a4-91e6-9e8d8fb19eee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:15.392977 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-93273ca5-9fbc-47a4-91e6-9e8d8fb19eee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:15.396444 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-93273ca5-9fbc-47a4-91e6-9e8d8fb19eee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:15.397074 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-93273ca5-9fbc-47a4-91e6-9e8d8fb19eee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:15.401940 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a42fcb5a-d225-4026-82db-141a2bcf5707 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:15.430749 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a42fcb5a-d225-4026-82db-141a2bcf5707 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1720 microversion: 2.1 time: 0.405093 Nov 12 02:30:15.431441 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 377/781] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:15 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1720 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:30:15.575042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-93273ca5-9fbc-47a4-91e6-9e8d8fb19eee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:15.586399 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-93273ca5-9fbc-47a4-91e6-9e8d8fb19eee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:15.588269 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-93273ca5-9fbc-47a4-91e6-9e8d8fb19eee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:15.589535 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-93273ca5-9fbc-47a4-91e6-9e8d8fb19eee tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.220440 Nov 12 02:30:15.590357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 405/782] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:15 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:16.256448 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-799627e3-72f1-4bd5-bb12-e68ee4718808 req-a343d975-638a-4820-8df5-35b42b5a4901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc3ef58-e30c-44da-bef1-9678e3c7b14a", "name": "network-vif-deleted", "tag": "838aaf11-0ed7-4529-b85a-74acc6e006ad"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:30:16.259322 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:30:16.259322 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:30:16.267476 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-799627e3-72f1-4bd5-bb12-e68ee4718808 req-a343d975-638a-4820-8df5-35b42b5a4901 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:16.267917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-799627e3-72f1-4bd5-bb12-e68ee4718808 req-a343d975-638a-4820-8df5-35b42b5a4901 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:16.289108 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-799627e3-72f1-4bd5-bb12-e68ee4718808 req-a343d975-638a-4820-8df5-35b42b5a4901 service nova] Creating event network-vif-deleted:838aaf11-0ed7-4529-b85a-74acc6e006ad for instance 7dc3ef58-e30c-44da-bef1-9678e3c7b14a on hv-cinder-80857 Nov 12 02:30:16.296738 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-799627e3-72f1-4bd5-bb12-e68ee4718808 req-a343d975-638a-4820-8df5-35b42b5a4901 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045003 Nov 12 02:30:16.297331 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 378/783] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:30:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:30:16.384566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-57b463bf-394f-4db2-93c6-9151ba113543 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:16.385166 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-57b463bf-394f-4db2-93c6-9151ba113543 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:16.391722 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-57b463bf-394f-4db2-93c6-9151ba113543 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:16.392116 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-57b463bf-394f-4db2-93c6-9151ba113543 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:16.392948 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-57b463bf-394f-4db2-93c6-9151ba113543 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:16.393658 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-57b463bf-394f-4db2-93c6-9151ba113543 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:16.427356 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-57b463bf-394f-4db2-93c6-9151ba113543 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:16.427977 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-57b463bf-394f-4db2-93c6-9151ba113543 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:16.428447 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-57b463bf-394f-4db2-93c6-9151ba113543 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lazy-loading 'fault' on Instance uuid 7dc3ef58-e30c-44da-bef1-9678e3c7b14a {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:30:16.448880 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9bb5d446-6f6f-4285-9752-edb228bfb19c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:16.449690 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9bb5d446-6f6f-4285-9752-edb228bfb19c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:16.455886 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9bb5d446-6f6f-4285-9752-edb228bfb19c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:16.457150 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9bb5d446-6f6f-4285-9752-edb228bfb19c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:16.457936 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9bb5d446-6f6f-4285-9752-edb228bfb19c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:16.458534 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9bb5d446-6f6f-4285-9752-edb228bfb19c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:16.473572 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-57b463bf-394f-4db2-93c6-9151ba113543 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f90ce43dddc437fbd6d0531529c6456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1009072a7446b8a468d02d87b9420d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:16.480770 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-57b463bf-394f-4db2-93c6-9151ba113543 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 200 len: 1308 microversion: 2.1 time: 0.099741 Nov 12 02:30:16.481345 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 406/784] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:16 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:16.605976 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9bb5d446-6f6f-4285-9752-edb228bfb19c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:16.607954 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-18aed7aa-c4d7-428a-a72d-eb595f5e1ae8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:16.608652 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-18aed7aa-c4d7-428a-a72d-eb595f5e1ae8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:16.615409 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18aed7aa-c4d7-428a-a72d-eb595f5e1ae8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:16.615853 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18aed7aa-c4d7-428a-a72d-eb595f5e1ae8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:16.616213 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9bb5d446-6f6f-4285-9752-edb228bfb19c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1720 microversion: 2.1 time: 0.170950 Nov 12 02:30:16.616824 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18aed7aa-c4d7-428a-a72d-eb595f5e1ae8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:16.617255 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18aed7aa-c4d7-428a-a72d-eb595f5e1ae8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:16.619384 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 379/785] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:16 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:30:16.818321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-18aed7aa-c4d7-428a-a72d-eb595f5e1ae8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:16.828678 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-18aed7aa-c4d7-428a-a72d-eb595f5e1ae8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:16.830635 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-18aed7aa-c4d7-428a-a72d-eb595f5e1ae8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:16.831895 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-18aed7aa-c4d7-428a-a72d-eb595f5e1ae8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.227557 Nov 12 02:30:16.832443 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 407/786] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:16 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:30:17.499156 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b9540f19-eb2f-4cb2-aad5-b43d752e3a50 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:17.499867 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b9540f19-eb2f-4cb2-aad5-b43d752e3a50 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] [instance: 7dc3ef58-e30c-44da-bef1-9678e3c7b14a] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:17.508549 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9540f19-eb2f-4cb2-aad5-b43d752e3a50 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:17.509020 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9540f19-eb2f-4cb2-aad5-b43d752e3a50 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:17.509881 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9540f19-eb2f-4cb2-aad5-b43d752e3a50 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:17.510481 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b9540f19-eb2f-4cb2-aad5-b43d752e3a50 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:17.524442 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-b9540f19-eb2f-4cb2-aad5-b43d752e3a50 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] HTTP exception thrown: Instance 7dc3ef58-e30c-44da-bef1-9678e3c7b14a could not be found. Nov 12 02:30:17.525041 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b9540f19-eb2f-4cb2-aad5-b43d752e3a50 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] Returning 404 to user: Instance 7dc3ef58-e30c-44da-bef1-9678e3c7b14a could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:30:17.525866 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b9540f19-eb2f-4cb2-aad5-b43d752e3a50 tempest-AttachVolumeNegativeTest-1074144814 tempest-AttachVolumeNegativeTest-1074144814-project] 10.222.0.70 "GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a" status: 404 len: 111 microversion: 2.1 time: 0.031814 Nov 12 02:30:17.526419 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 380/787] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:17 2021] GET /compute/v2.1/servers/7dc3ef58-e30c-44da-bef1-9678e3c7b14a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:30:17.633506 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e21a1a16-8725-431c-805d-9527cf5cc3f3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:17.634117 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e21a1a16-8725-431c-805d-9527cf5cc3f3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:17.642455 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e21a1a16-8725-431c-805d-9527cf5cc3f3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:17.643104 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e21a1a16-8725-431c-805d-9527cf5cc3f3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:17.645734 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e21a1a16-8725-431c-805d-9527cf5cc3f3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:17.646240 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e21a1a16-8725-431c-805d-9527cf5cc3f3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:17.838514 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e21a1a16-8725-431c-805d-9527cf5cc3f3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:17.850461 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-37b15a52-7ee3-41ea-8caa-ecc333a60768 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:17.851241 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-37b15a52-7ee3-41ea-8caa-ecc333a60768 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:17.862546 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37b15a52-7ee3-41ea-8caa-ecc333a60768 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:17.864615 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e21a1a16-8725-431c-805d-9527cf5cc3f3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1720 microversion: 2.1 time: 0.229508 Nov 12 02:30:17.879336 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37b15a52-7ee3-41ea-8caa-ecc333a60768 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:17.880260 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37b15a52-7ee3-41ea-8caa-ecc333a60768 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:17.880912 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 408/788] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:17 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1720 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:17.881966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-37b15a52-7ee3-41ea-8caa-ecc333a60768 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:18.037654 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-37b15a52-7ee3-41ea-8caa-ecc333a60768 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:18.054633 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-37b15a52-7ee3-41ea-8caa-ecc333a60768 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:18.056500 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-37b15a52-7ee3-41ea-8caa-ecc333a60768 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:18.057782 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-37b15a52-7ee3-41ea-8caa-ecc333a60768 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1743 microversion: 2.20 time: 0.211633 Nov 12 02:30:18.058441 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 381/789] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:17 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1743 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:18.889885 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-91c43bc4-987b-4fc1-b5fd-371e5b0577a1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:18.890775 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-91c43bc4-987b-4fc1-b5fd-371e5b0577a1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:18.898064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-91c43bc4-987b-4fc1-b5fd-371e5b0577a1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:18.899547 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-91c43bc4-987b-4fc1-b5fd-371e5b0577a1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:18.900673 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-91c43bc4-987b-4fc1-b5fd-371e5b0577a1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:18.901779 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-91c43bc4-987b-4fc1-b5fd-371e5b0577a1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:19.077548 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a9ed29df-c421-4cff-8b49-51bfec804a3f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:19.078248 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a9ed29df-c421-4cff-8b49-51bfec804a3f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:19.091702 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-91c43bc4-987b-4fc1-b5fd-371e5b0577a1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:19.092191 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a9ed29df-c421-4cff-8b49-51bfec804a3f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:19.093266 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a9ed29df-c421-4cff-8b49-51bfec804a3f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:19.096972 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a9ed29df-c421-4cff-8b49-51bfec804a3f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:19.097691 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a9ed29df-c421-4cff-8b49-51bfec804a3f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:19.100659 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-91c43bc4-987b-4fc1-b5fd-371e5b0577a1 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1720 microversion: 2.1 time: 0.216177 Nov 12 02:30:19.105527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 409/790] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:18 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:19.293522 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a9ed29df-c421-4cff-8b49-51bfec804a3f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:19.305309 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a9ed29df-c421-4cff-8b49-51bfec804a3f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:19.307335 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a9ed29df-c421-4cff-8b49-51bfec804a3f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:19.310447 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a9ed29df-c421-4cff-8b49-51bfec804a3f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1743 microversion: 2.20 time: 0.237465 Nov 12 02:30:19.312272 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 382/791] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:19 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1743 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:30:20.121455 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-59a5fde4-48ad-4061-a7a2-886c8cd2fdce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:20.122244 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-59a5fde4-48ad-4061-a7a2-886c8cd2fdce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:20.131981 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-59a5fde4-48ad-4061-a7a2-886c8cd2fdce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:20.132955 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-59a5fde4-48ad-4061-a7a2-886c8cd2fdce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:20.133958 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-59a5fde4-48ad-4061-a7a2-886c8cd2fdce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:20.134649 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-59a5fde4-48ad-4061-a7a2-886c8cd2fdce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:20.296227 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-59a5fde4-48ad-4061-a7a2-886c8cd2fdce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:20.320911 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-59a5fde4-48ad-4061-a7a2-886c8cd2fdce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1720 microversion: 2.1 time: 0.203262 Nov 12 02:30:20.322318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 410/792] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:20 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1720 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:20.329840 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6da8d901-84d8-4eb7-94ac-3a50de61ec16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:20.330480 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6da8d901-84d8-4eb7-94ac-3a50de61ec16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:20.338936 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6da8d901-84d8-4eb7-94ac-3a50de61ec16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:20.339727 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6da8d901-84d8-4eb7-94ac-3a50de61ec16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:20.340517 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6da8d901-84d8-4eb7-94ac-3a50de61ec16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:20.341106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6da8d901-84d8-4eb7-94ac-3a50de61ec16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:20.492746 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6da8d901-84d8-4eb7-94ac-3a50de61ec16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:20.500802 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6da8d901-84d8-4eb7-94ac-3a50de61ec16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:20.502870 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6da8d901-84d8-4eb7-94ac-3a50de61ec16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:20.512532 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6da8d901-84d8-4eb7-94ac-3a50de61ec16 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1743 microversion: 2.20 time: 0.186151 Nov 12 02:30:20.513130 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 383/793] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:20 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:21.176344 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-7e8f38f9-1fb6-4f62-85b7-79dbab523165 req-d4b9ab1d-9ddf-4724-8248-5f0e9a4ea6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d16c68-a04c-4a32-a599-e202e6c64152", "name": "network-vif-plugged", "status": "completed", "tag": "6159a4de-08df-4c5b-afb6-bc1f4e2f213f"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:30:21.178330 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:30:21.178330 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:30:21.188252 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-7e8f38f9-1fb6-4f62-85b7-79dbab523165 req-d4b9ab1d-9ddf-4724-8248-5f0e9a4ea6a2 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:21.189111 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-7e8f38f9-1fb6-4f62-85b7-79dbab523165 req-d4b9ab1d-9ddf-4724-8248-5f0e9a4ea6a2 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:21.206744 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-7e8f38f9-1fb6-4f62-85b7-79dbab523165 req-d4b9ab1d-9ddf-4724-8248-5f0e9a4ea6a2 service nova] Creating event network-vif-plugged:6159a4de-08df-4c5b-afb6-bc1f4e2f213f for instance 26d16c68-a04c-4a32-a599-e202e6c64152 on hv-cinder-80857 Nov 12 02:30:21.213208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-7e8f38f9-1fb6-4f62-85b7-79dbab523165 req-d4b9ab1d-9ddf-4724-8248-5f0e9a4ea6a2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059471 Nov 12 02:30:21.214626 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 411/794] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:30:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:30:21.339771 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e98200db-0fff-469e-91fd-8501b1352021 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:21.341629 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e98200db-0fff-469e-91fd-8501b1352021 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:21.352750 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e98200db-0fff-469e-91fd-8501b1352021 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:21.353922 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e98200db-0fff-469e-91fd-8501b1352021 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:21.355320 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e98200db-0fff-469e-91fd-8501b1352021 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:21.355973 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e98200db-0fff-469e-91fd-8501b1352021 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:21.531965 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0cc0a424-d944-4ec4-91a8-3c1c09bc9c37 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:21.533104 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0cc0a424-d944-4ec4-91a8-3c1c09bc9c37 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:21.541632 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0cc0a424-d944-4ec4-91a8-3c1c09bc9c37 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:21.543038 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0cc0a424-d944-4ec4-91a8-3c1c09bc9c37 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:21.544687 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0cc0a424-d944-4ec4-91a8-3c1c09bc9c37 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:21.545202 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0cc0a424-d944-4ec4-91a8-3c1c09bc9c37 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:21.920030 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e98200db-0fff-469e-91fd-8501b1352021 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:21.932547 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e98200db-0fff-469e-91fd-8501b1352021 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1720 microversion: 2.1 time: 0.597755 Nov 12 02:30:21.933220 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 384/795] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:21 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1720 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:22.002004 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0cc0a424-d944-4ec4-91a8-3c1c09bc9c37 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:22.012559 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0cc0a424-d944-4ec4-91a8-3c1c09bc9c37 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:22.015507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0cc0a424-d944-4ec4-91a8-3c1c09bc9c37 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:22.016668 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0cc0a424-d944-4ec4-91a8-3c1c09bc9c37 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1743 microversion: 2.20 time: 0.488899 Nov 12 02:30:22.017457 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 412/796] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:21 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1743 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:22.953505 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-476efcf8-7cde-461b-9632-6d3e2f329c77 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:22.954150 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-476efcf8-7cde-461b-9632-6d3e2f329c77 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:22.961256 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-476efcf8-7cde-461b-9632-6d3e2f329c77 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:22.965088 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-476efcf8-7cde-461b-9632-6d3e2f329c77 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:22.965917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-476efcf8-7cde-461b-9632-6d3e2f329c77 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:22.966698 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-476efcf8-7cde-461b-9632-6d3e2f329c77 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:23.035471 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a9c7f0d5-1e0a-4abc-a764-4d39c8653ff8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:23.036648 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a9c7f0d5-1e0a-4abc-a764-4d39c8653ff8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:23.043271 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a9c7f0d5-1e0a-4abc-a764-4d39c8653ff8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:23.043945 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a9c7f0d5-1e0a-4abc-a764-4d39c8653ff8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:23.044918 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a9c7f0d5-1e0a-4abc-a764-4d39c8653ff8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:23.045514 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a9c7f0d5-1e0a-4abc-a764-4d39c8653ff8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:23.168361 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-476efcf8-7cde-461b-9632-6d3e2f329c77 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:23.178532 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-476efcf8-7cde-461b-9632-6d3e2f329c77 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1720 microversion: 2.1 time: 0.230481 Nov 12 02:30:23.183392 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 385/797] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:22 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1720 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:23.244045 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a9c7f0d5-1e0a-4abc-a764-4d39c8653ff8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:23.252273 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a9c7f0d5-1e0a-4abc-a764-4d39c8653ff8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:23.254470 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a9c7f0d5-1e0a-4abc-a764-4d39c8653ff8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:23.255789 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a9c7f0d5-1e0a-4abc-a764-4d39c8653ff8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1743 microversion: 2.20 time: 0.223901 Nov 12 02:30:23.256220 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 413/798] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:23 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1743 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:30:24.197556 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b81331a6-65bb-4d1b-b25b-378740229fe2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:24.198468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b81331a6-65bb-4d1b-b25b-378740229fe2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:24.205147 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b81331a6-65bb-4d1b-b25b-378740229fe2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:24.205600 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b81331a6-65bb-4d1b-b25b-378740229fe2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:24.206496 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b81331a6-65bb-4d1b-b25b-378740229fe2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:24.207200 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b81331a6-65bb-4d1b-b25b-378740229fe2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:24.273834 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-00308896-1cc5-4a86-acbb-18769a8a6d5a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:24.274439 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-00308896-1cc5-4a86-acbb-18769a8a6d5a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:24.282517 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-00308896-1cc5-4a86-acbb-18769a8a6d5a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:24.283207 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-00308896-1cc5-4a86-acbb-18769a8a6d5a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:24.285381 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-00308896-1cc5-4a86-acbb-18769a8a6d5a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:24.286133 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-00308896-1cc5-4a86-acbb-18769a8a6d5a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:24.405117 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b81331a6-65bb-4d1b-b25b-378740229fe2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:24.428499 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b81331a6-65bb-4d1b-b25b-378740229fe2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1697 microversion: 2.1 time: 0.235008 Nov 12 02:30:24.434767 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 386/799] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:24 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1697 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:24.453129 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b1ac409d-cec5-413f-8fbc-d5d0f7aa4fb8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:30:24.459555 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b1ac409d-cec5-413f-8fbc-d5d0f7aa4fb8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:24.460258 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b1ac409d-cec5-413f-8fbc-d5d0f7aa4fb8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:24.502220 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b1ac409d-cec5-413f-8fbc-d5d0f7aa4fb8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Going to try to start instance {{(pid=116098) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 12 02:30:24.513004 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-00308896-1cc5-4a86-acbb-18769a8a6d5a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:24.522928 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-00308896-1cc5-4a86-acbb-18769a8a6d5a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:24.544947 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-00308896-1cc5-4a86-acbb-18769a8a6d5a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:24.547098 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-00308896-1cc5-4a86-acbb-18769a8a6d5a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1738 microversion: 2.20 time: 0.276456 Nov 12 02:30:24.566261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 414/800] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:24 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1738 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:24.598990 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b1ac409d-cec5-413f-8fbc-d5d0f7aa4fb8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 202 len: 0 microversion: 2.1 time: 0.149102 Nov 12 02:30:24.600045 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 387/801] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:30:24 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:30:24.607997 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d1b54f4c-d588-4a9f-baa5-04d24dff98da tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:24.608990 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d1b54f4c-d588-4a9f-baa5-04d24dff98da tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:24.628527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1b54f4c-d588-4a9f-baa5-04d24dff98da tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:24.629181 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1b54f4c-d588-4a9f-baa5-04d24dff98da tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:24.630209 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1b54f4c-d588-4a9f-baa5-04d24dff98da tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:24.631250 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1b54f4c-d588-4a9f-baa5-04d24dff98da tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:24.899468 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d1b54f4c-d588-4a9f-baa5-04d24dff98da tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:24.908138 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d1b54f4c-d588-4a9f-baa5-04d24dff98da tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1706 microversion: 2.1 time: 0.303746 Nov 12 02:30:24.911843 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 415/802] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:24 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1706 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:25.573759 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-606ad7a2-6c0b-429b-83e9-57bb126696f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:25.575442 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-606ad7a2-6c0b-429b-83e9-57bb126696f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:25.592324 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-606ad7a2-6c0b-429b-83e9-57bb126696f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:25.593033 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-606ad7a2-6c0b-429b-83e9-57bb126696f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:25.595425 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-606ad7a2-6c0b-429b-83e9-57bb126696f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:25.596756 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-606ad7a2-6c0b-429b-83e9-57bb126696f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:25.784986 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-606ad7a2-6c0b-429b-83e9-57bb126696f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:25.813235 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-606ad7a2-6c0b-429b-83e9-57bb126696f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:25.815141 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-606ad7a2-6c0b-429b-83e9-57bb126696f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:25.817168 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-606ad7a2-6c0b-429b-83e9-57bb126696f5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1738 microversion: 2.20 time: 0.246818 Nov 12 02:30:25.829546 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 388/803] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:25 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:25.931137 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5bc6d093-8f15-40b4-ad30-82bba4e1c26d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:25.932515 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5bc6d093-8f15-40b4-ad30-82bba4e1c26d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:25.941868 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5bc6d093-8f15-40b4-ad30-82bba4e1c26d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:25.951820 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5bc6d093-8f15-40b4-ad30-82bba4e1c26d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:25.952692 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5bc6d093-8f15-40b4-ad30-82bba4e1c26d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:25.953135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5bc6d093-8f15-40b4-ad30-82bba4e1c26d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:26.162433 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5bc6d093-8f15-40b4-ad30-82bba4e1c26d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:26.171586 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5bc6d093-8f15-40b4-ad30-82bba4e1c26d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1706 microversion: 2.1 time: 0.247318 Nov 12 02:30:26.173072 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 416/804] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:25 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1706 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:26.836362 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4385d01a-b4b1-4d45-b043-a9a111bdf19c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:26.838071 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4385d01a-b4b1-4d45-b043-a9a111bdf19c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:26.846756 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4385d01a-b4b1-4d45-b043-a9a111bdf19c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:26.848292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4385d01a-b4b1-4d45-b043-a9a111bdf19c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:26.849194 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4385d01a-b4b1-4d45-b043-a9a111bdf19c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:26.850129 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4385d01a-b4b1-4d45-b043-a9a111bdf19c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:27.077895 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4385d01a-b4b1-4d45-b043-a9a111bdf19c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:27.106205 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4385d01a-b4b1-4d45-b043-a9a111bdf19c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:27.113842 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4385d01a-b4b1-4d45-b043-a9a111bdf19c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:27.115611 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4385d01a-b4b1-4d45-b043-a9a111bdf19c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1738 microversion: 2.20 time: 0.284048 Nov 12 02:30:27.116963 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 389/805] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:26 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1738 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:27.189712 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8822049e-c165-4966-980e-8d372d74f74a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:27.191490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8822049e-c165-4966-980e-8d372d74f74a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:27.211306 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8822049e-c165-4966-980e-8d372d74f74a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:27.212309 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8822049e-c165-4966-980e-8d372d74f74a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:27.213711 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8822049e-c165-4966-980e-8d372d74f74a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:27.214355 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8822049e-c165-4966-980e-8d372d74f74a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:27.476318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8822049e-c165-4966-980e-8d372d74f74a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:27.484363 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8822049e-c165-4966-980e-8d372d74f74a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1710 microversion: 2.1 time: 0.298910 Nov 12 02:30:27.499499 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 417/806] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:30:27 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1710 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:30:28.142093 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c09d3234-7e01-44ee-a11b-83b172fce481 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:28.144646 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c09d3234-7e01-44ee-a11b-83b172fce481 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:28.180905 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c09d3234-7e01-44ee-a11b-83b172fce481 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:28.180905 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c09d3234-7e01-44ee-a11b-83b172fce481 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:28.182269 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c09d3234-7e01-44ee-a11b-83b172fce481 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:28.183012 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c09d3234-7e01-44ee-a11b-83b172fce481 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:28.373406 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c09d3234-7e01-44ee-a11b-83b172fce481 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:28.389862 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c09d3234-7e01-44ee-a11b-83b172fce481 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:28.392934 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c09d3234-7e01-44ee-a11b-83b172fce481 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:28.396390 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c09d3234-7e01-44ee-a11b-83b172fce481 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1738 microversion: 2.20 time: 0.264449 Nov 12 02:30:28.397098 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 390/807] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:28 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:29.422243 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9220847e-9237-42f7-9d89-8aac114c18bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:29.422925 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9220847e-9237-42f7-9d89-8aac114c18bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:29.430209 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9220847e-9237-42f7-9d89-8aac114c18bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:29.430655 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9220847e-9237-42f7-9d89-8aac114c18bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:29.431465 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9220847e-9237-42f7-9d89-8aac114c18bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:29.431899 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9220847e-9237-42f7-9d89-8aac114c18bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:29.612573 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9220847e-9237-42f7-9d89-8aac114c18bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:29.623128 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9220847e-9237-42f7-9d89-8aac114c18bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:29.624338 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9220847e-9237-42f7-9d89-8aac114c18bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:29.625515 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9220847e-9237-42f7-9d89-8aac114c18bd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1738 microversion: 2.20 time: 0.208939 Nov 12 02:30:29.626090 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 418/808] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:29 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:30:30.643237 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3307fabd-6301-4066-9480-1b76569e007a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:30.645200 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3307fabd-6301-4066-9480-1b76569e007a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:30.654385 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3307fabd-6301-4066-9480-1b76569e007a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:30.654862 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3307fabd-6301-4066-9480-1b76569e007a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:30.655641 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3307fabd-6301-4066-9480-1b76569e007a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:30.656335 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3307fabd-6301-4066-9480-1b76569e007a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:30.806573 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3307fabd-6301-4066-9480-1b76569e007a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:30.816914 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3307fabd-6301-4066-9480-1b76569e007a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:30.818443 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3307fabd-6301-4066-9480-1b76569e007a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:30.819823 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3307fabd-6301-4066-9480-1b76569e007a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1738 microversion: 2.20 time: 0.180080 Nov 12 02:30:30.820560 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 391/809] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:30 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:31.840128 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ab29c976-86a1-4560-9a65-c299d3f65e4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:31.840994 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ab29c976-86a1-4560-9a65-c299d3f65e4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:31.849575 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ab29c976-86a1-4560-9a65-c299d3f65e4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:31.850333 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ab29c976-86a1-4560-9a65-c299d3f65e4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:31.851397 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ab29c976-86a1-4560-9a65-c299d3f65e4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:31.852408 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ab29c976-86a1-4560-9a65-c299d3f65e4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:32.011790 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ab29c976-86a1-4560-9a65-c299d3f65e4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:32.019786 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ab29c976-86a1-4560-9a65-c299d3f65e4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:32.021322 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ab29c976-86a1-4560-9a65-c299d3f65e4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:32.022569 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ab29c976-86a1-4560-9a65-c299d3f65e4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1738 microversion: 2.20 time: 0.186559 Nov 12 02:30:32.023233 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 419/810] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:31 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:33.045364 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fae27b28-207a-460c-8f68-43c1e27a1f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:33.046785 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fae27b28-207a-460c-8f68-43c1e27a1f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:33.058346 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fae27b28-207a-460c-8f68-43c1e27a1f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:33.059340 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fae27b28-207a-460c-8f68-43c1e27a1f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:33.062416 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fae27b28-207a-460c-8f68-43c1e27a1f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:33.063342 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fae27b28-207a-460c-8f68-43c1e27a1f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:33.266474 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fae27b28-207a-460c-8f68-43c1e27a1f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:33.278347 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fae27b28-207a-460c-8f68-43c1e27a1f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:33.280445 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fae27b28-207a-460c-8f68-43c1e27a1f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:33.282285 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fae27b28-207a-460c-8f68-43c1e27a1f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1738 microversion: 2.20 time: 0.243193 Nov 12 02:30:33.283091 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 392/811] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:33 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:34.301679 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b202a9fe-8704-477a-8462-9aa1fb08036c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:34.303368 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b202a9fe-8704-477a-8462-9aa1fb08036c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:34.314062 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b202a9fe-8704-477a-8462-9aa1fb08036c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:34.318884 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b202a9fe-8704-477a-8462-9aa1fb08036c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:34.320030 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b202a9fe-8704-477a-8462-9aa1fb08036c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:34.320847 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b202a9fe-8704-477a-8462-9aa1fb08036c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:34.505291 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b202a9fe-8704-477a-8462-9aa1fb08036c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:34.528004 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b202a9fe-8704-477a-8462-9aa1fb08036c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:34.529582 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b202a9fe-8704-477a-8462-9aa1fb08036c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:34.530844 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b202a9fe-8704-477a-8462-9aa1fb08036c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1738 microversion: 2.20 time: 0.233790 Nov 12 02:30:34.531843 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 420/812] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:34 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:35.555894 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-612403c4-29f0-4c78-9aa6-b596abcf269b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:35.556813 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-612403c4-29f0-4c78-9aa6-b596abcf269b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:35.567063 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-612403c4-29f0-4c78-9aa6-b596abcf269b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:35.567703 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-612403c4-29f0-4c78-9aa6-b596abcf269b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:35.569538 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-612403c4-29f0-4c78-9aa6-b596abcf269b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:35.570185 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-612403c4-29f0-4c78-9aa6-b596abcf269b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:35.774330 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-612403c4-29f0-4c78-9aa6-b596abcf269b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:35.786773 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-612403c4-29f0-4c78-9aa6-b596abcf269b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:35.791057 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-612403c4-29f0-4c78-9aa6-b596abcf269b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:35.791057 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-612403c4-29f0-4c78-9aa6-b596abcf269b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1738 microversion: 2.20 time: 0.241428 Nov 12 02:30:35.791057 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 393/813] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:35 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:36.811527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8735ceaf-1c95-45cc-aea8-6fc0b83e0ca2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:36.812358 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8735ceaf-1c95-45cc-aea8-6fc0b83e0ca2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:36.820437 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8735ceaf-1c95-45cc-aea8-6fc0b83e0ca2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:36.821118 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8735ceaf-1c95-45cc-aea8-6fc0b83e0ca2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:36.822193 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8735ceaf-1c95-45cc-aea8-6fc0b83e0ca2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:36.822658 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8735ceaf-1c95-45cc-aea8-6fc0b83e0ca2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:36.995031 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8735ceaf-1c95-45cc-aea8-6fc0b83e0ca2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:37.007543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8735ceaf-1c95-45cc-aea8-6fc0b83e0ca2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:37.010016 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8735ceaf-1c95-45cc-aea8-6fc0b83e0ca2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:37.011655 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8735ceaf-1c95-45cc-aea8-6fc0b83e0ca2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1738 microversion: 2.20 time: 0.205279 Nov 12 02:30:37.012447 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 421/814] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:36 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:38.031467 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-06d024be-f256-4753-bb80-3819dc6b70d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:38.031992 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-06d024be-f256-4753-bb80-3819dc6b70d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:38.038066 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-06d024be-f256-4753-bb80-3819dc6b70d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:38.038509 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-06d024be-f256-4753-bb80-3819dc6b70d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:38.039328 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-06d024be-f256-4753-bb80-3819dc6b70d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:38.039761 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-06d024be-f256-4753-bb80-3819dc6b70d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:38.185637 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-06d024be-f256-4753-bb80-3819dc6b70d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:38.196761 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-06d024be-f256-4753-bb80-3819dc6b70d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:38.198545 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-06d024be-f256-4753-bb80-3819dc6b70d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:38.200013 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-06d024be-f256-4753-bb80-3819dc6b70d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1738 microversion: 2.20 time: 0.172383 Nov 12 02:30:38.200562 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 394/815] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:38 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:39.220516 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6ef8196f-f853-4717-9fe9-3ab429a3f813 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:39.221111 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6ef8196f-f853-4717-9fe9-3ab429a3f813 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:39.230528 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ef8196f-f853-4717-9fe9-3ab429a3f813 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:39.231056 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ef8196f-f853-4717-9fe9-3ab429a3f813 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:39.231842 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ef8196f-f853-4717-9fe9-3ab429a3f813 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:39.232417 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ef8196f-f853-4717-9fe9-3ab429a3f813 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:39.404993 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6ef8196f-f853-4717-9fe9-3ab429a3f813 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:39.413731 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6ef8196f-f853-4717-9fe9-3ab429a3f813 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:39.415482 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6ef8196f-f853-4717-9fe9-3ab429a3f813 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:39.416647 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6ef8196f-f853-4717-9fe9-3ab429a3f813 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1738 microversion: 2.20 time: 0.200091 Nov 12 02:30:39.417628 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 422/816] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:39 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:40.437168 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-50e7f900-b656-4438-a4ce-64a8298409d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:40.437906 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-50e7f900-b656-4438-a4ce-64a8298409d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:40.445564 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-50e7f900-b656-4438-a4ce-64a8298409d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:40.446062 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-50e7f900-b656-4438-a4ce-64a8298409d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:40.446897 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-50e7f900-b656-4438-a4ce-64a8298409d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:40.447333 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-50e7f900-b656-4438-a4ce-64a8298409d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:40.621779 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-50e7f900-b656-4438-a4ce-64a8298409d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:40.630736 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-50e7f900-b656-4438-a4ce-64a8298409d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:40.633765 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-50e7f900-b656-4438-a4ce-64a8298409d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:40.636130 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-50e7f900-b656-4438-a4ce-64a8298409d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1720 microversion: 2.20 time: 0.202627 Nov 12 02:30:40.636816 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 395/817] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:40 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1720 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:41.660297 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-dff250d3-8db5-4259-bd41-60add1bed418 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:41.661215 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-dff250d3-8db5-4259-bd41-60add1bed418 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:41.669686 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dff250d3-8db5-4259-bd41-60add1bed418 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:41.670329 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dff250d3-8db5-4259-bd41-60add1bed418 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:41.671188 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dff250d3-8db5-4259-bd41-60add1bed418 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:41.671799 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dff250d3-8db5-4259-bd41-60add1bed418 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:41.911752 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-dff250d3-8db5-4259-bd41-60add1bed418 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:41.920125 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-dff250d3-8db5-4259-bd41-60add1bed418 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:41.921877 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-dff250d3-8db5-4259-bd41-60add1bed418 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:41.923156 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-dff250d3-8db5-4259-bd41-60add1bed418 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1720 microversion: 2.20 time: 0.266716 Nov 12 02:30:41.924174 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 423/818] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:41 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1720 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:42.942735 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-14385c1c-6f9f-4757-987a-16595fbe4f2d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:42.943318 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-14385c1c-6f9f-4757-987a-16595fbe4f2d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:42.954782 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14385c1c-6f9f-4757-987a-16595fbe4f2d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:42.957466 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14385c1c-6f9f-4757-987a-16595fbe4f2d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:42.959260 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14385c1c-6f9f-4757-987a-16595fbe4f2d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:42.960302 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14385c1c-6f9f-4757-987a-16595fbe4f2d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:43.161272 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-14385c1c-6f9f-4757-987a-16595fbe4f2d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:43.169682 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-14385c1c-6f9f-4757-987a-16595fbe4f2d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:43.171259 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-14385c1c-6f9f-4757-987a-16595fbe4f2d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:43.172424 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-14385c1c-6f9f-4757-987a-16595fbe4f2d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1720 microversion: 2.20 time: 0.234925 Nov 12 02:30:43.173501 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 396/819] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:42 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1720 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:44.196281 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-272f50c3-8ab5-492a-8cff-b7e2550672b4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:44.197465 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-272f50c3-8ab5-492a-8cff-b7e2550672b4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:44.203197 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-272f50c3-8ab5-492a-8cff-b7e2550672b4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:44.203881 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-272f50c3-8ab5-492a-8cff-b7e2550672b4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:44.204829 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-272f50c3-8ab5-492a-8cff-b7e2550672b4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:44.205622 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-272f50c3-8ab5-492a-8cff-b7e2550672b4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:44.364126 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-818359e8-e741-48c4-9129-50d485de712e req-d963ed6a-458d-46d3-a4a5-062f44163b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d16c68-a04c-4a32-a599-e202e6c64152", "name": "network-vif-unplugged", "status": "completed", "tag": "6159a4de-08df-4c5b-afb6-bc1f4e2f213f"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:30:44.365902 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:30:44.365902 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:30:44.376959 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-818359e8-e741-48c4-9129-50d485de712e req-d963ed6a-458d-46d3-a4a5-062f44163b66 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:44.380832 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-818359e8-e741-48c4-9129-50d485de712e req-d963ed6a-458d-46d3-a4a5-062f44163b66 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:44.384660 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-272f50c3-8ab5-492a-8cff-b7e2550672b4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:44.398611 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-272f50c3-8ab5-492a-8cff-b7e2550672b4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:44.401380 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-272f50c3-8ab5-492a-8cff-b7e2550672b4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:44.402456 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-818359e8-e741-48c4-9129-50d485de712e req-d963ed6a-458d-46d3-a4a5-062f44163b66 service nova] Creating event network-vif-unplugged:6159a4de-08df-4c5b-afb6-bc1f4e2f213f for instance 26d16c68-a04c-4a32-a599-e202e6c64152 on hv-cinder-80857 Nov 12 02:30:44.404957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-272f50c3-8ab5-492a-8cff-b7e2550672b4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1720 microversion: 2.20 time: 0.213102 Nov 12 02:30:44.406262 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 424/820] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:44 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:44.411839 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-818359e8-e741-48c4-9129-50d485de712e req-d963ed6a-458d-46d3-a4a5-062f44163b66 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056310 Nov 12 02:30:44.412660 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 397/821] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:30:44 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:30:45.429147 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-67bc7bc8-5fb5-4db8-b76c-d425fedcf7c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:45.429805 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-67bc7bc8-5fb5-4db8-b76c-d425fedcf7c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:45.436513 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-67bc7bc8-5fb5-4db8-b76c-d425fedcf7c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:45.436983 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-67bc7bc8-5fb5-4db8-b76c-d425fedcf7c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:45.437759 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-67bc7bc8-5fb5-4db8-b76c-d425fedcf7c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:45.438198 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-67bc7bc8-5fb5-4db8-b76c-d425fedcf7c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:45.597284 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-67bc7bc8-5fb5-4db8-b76c-d425fedcf7c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:45.605675 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-67bc7bc8-5fb5-4db8-b76c-d425fedcf7c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:45.607198 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-67bc7bc8-5fb5-4db8-b76c-d425fedcf7c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:45.608346 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-67bc7bc8-5fb5-4db8-b76c-d425fedcf7c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1720 microversion: 2.20 time: 0.185321 Nov 12 02:30:45.609082 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 425/822] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:45 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:46.629008 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ac83cfa2-fd81-419a-acce-1c5f3c9c18c5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:46.629959 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ac83cfa2-fd81-419a-acce-1c5f3c9c18c5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:46.637124 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac83cfa2-fd81-419a-acce-1c5f3c9c18c5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:46.637830 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac83cfa2-fd81-419a-acce-1c5f3c9c18c5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:46.641733 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac83cfa2-fd81-419a-acce-1c5f3c9c18c5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:46.642240 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac83cfa2-fd81-419a-acce-1c5f3c9c18c5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:46.813616 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ac83cfa2-fd81-419a-acce-1c5f3c9c18c5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:46.826684 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ac83cfa2-fd81-419a-acce-1c5f3c9c18c5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:46.830300 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ac83cfa2-fd81-419a-acce-1c5f3c9c18c5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:46.830781 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ac83cfa2-fd81-419a-acce-1c5f3c9c18c5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1720 microversion: 2.20 time: 0.206611 Nov 12 02:30:46.838899 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 398/823] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:46 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:47.849493 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4a16c1ef-808e-43ea-894b-68ef3992aa4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:47.850024 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4a16c1ef-808e-43ea-894b-68ef3992aa4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:47.856888 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a16c1ef-808e-43ea-894b-68ef3992aa4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:47.857341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a16c1ef-808e-43ea-894b-68ef3992aa4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:47.858212 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a16c1ef-808e-43ea-894b-68ef3992aa4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:47.858569 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a16c1ef-808e-43ea-894b-68ef3992aa4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:48.001608 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4a16c1ef-808e-43ea-894b-68ef3992aa4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:48.010541 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4a16c1ef-808e-43ea-894b-68ef3992aa4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:48.012065 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4a16c1ef-808e-43ea-894b-68ef3992aa4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:48.013238 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4a16c1ef-808e-43ea-894b-68ef3992aa4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1663 microversion: 2.20 time: 0.167724 Nov 12 02:30:48.013785 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 426/824] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:47 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:48.031427 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-45a397e3-7f56-4d6c-b324-9a218373a280 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3b11ee5-ef9c-4ac0-bde6-de69a347da06"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:30:48.032458 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-45a397e3-7f56-4d6c-b324-9a218373a280 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:48.039934 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45a397e3-7f56-4d6c-b324-9a218373a280 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:48.040438 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45a397e3-7f56-4d6c-b324-9a218373a280 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:48.041390 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45a397e3-7f56-4d6c-b324-9a218373a280 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:48.041835 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-45a397e3-7f56-4d6c-b324-9a218373a280 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:48.385286 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-45a397e3-7f56-4d6c-b324-9a218373a280 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.358144 Nov 12 02:30:48.393539 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 399/825] 10.222.0.70 () {62 vars in 1363 bytes} [Fri Nov 12 02:30:48 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/os-volume_attachments => generated 188 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:30:48.538931 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-317e11a9-0aba-4787-8bc7-813dd650e6ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:30:48.539622 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-317e11a9-0aba-4787-8bc7-813dd650e6ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:48.546304 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-317e11a9-0aba-4787-8bc7-813dd650e6ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:48.546950 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-317e11a9-0aba-4787-8bc7-813dd650e6ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:48.547882 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-317e11a9-0aba-4787-8bc7-813dd650e6ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:48.548418 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-317e11a9-0aba-4787-8bc7-813dd650e6ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:48.662723 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-317e11a9-0aba-4787-8bc7-813dd650e6ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action" status: 202 len: 0 microversion: 2.20 time: 0.129023 Nov 12 02:30:48.663841 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 427/826] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:30:48 2021] POST /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:30:48.673083 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-29d5b4e0-fae6-4471-ac8e-1a06350f19ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:48.674159 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-29d5b4e0-fae6-4471-ac8e-1a06350f19ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:48.682814 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-29d5b4e0-fae6-4471-ac8e-1a06350f19ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:48.683262 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-29d5b4e0-fae6-4471-ac8e-1a06350f19ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:48.684172 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-29d5b4e0-fae6-4471-ac8e-1a06350f19ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:48.684598 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-29d5b4e0-fae6-4471-ac8e-1a06350f19ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:48.855413 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-29d5b4e0-fae6-4471-ac8e-1a06350f19ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:48.866442 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-29d5b4e0-fae6-4471-ac8e-1a06350f19ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:48.868276 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-29d5b4e0-fae6-4471-ac8e-1a06350f19ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:48.869575 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-29d5b4e0-fae6-4471-ac8e-1a06350f19ba tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1749 microversion: 2.20 time: 0.201492 Nov 12 02:30:48.874169 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 400/827] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:48 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1749 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:30:49.889773 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d02096e8-1a77-4a81-afe6-471ec9f8eaa9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:49.890390 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d02096e8-1a77-4a81-afe6-471ec9f8eaa9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:49.897523 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d02096e8-1a77-4a81-afe6-471ec9f8eaa9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:49.897964 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d02096e8-1a77-4a81-afe6-471ec9f8eaa9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:49.898818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d02096e8-1a77-4a81-afe6-471ec9f8eaa9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:49.899259 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d02096e8-1a77-4a81-afe6-471ec9f8eaa9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:50.054821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d02096e8-1a77-4a81-afe6-471ec9f8eaa9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:50.066658 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d02096e8-1a77-4a81-afe6-471ec9f8eaa9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:50.068354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d02096e8-1a77-4a81-afe6-471ec9f8eaa9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:50.069523 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d02096e8-1a77-4a81-afe6-471ec9f8eaa9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1749 microversion: 2.20 time: 0.184376 Nov 12 02:30:50.075920 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 428/828] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:49 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1749 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:30:51.088421 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-22f19d73-3ce7-483b-86d2-4c4b9302d11b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:51.089424 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-22f19d73-3ce7-483b-86d2-4c4b9302d11b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:51.095846 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22f19d73-3ce7-483b-86d2-4c4b9302d11b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:51.096382 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22f19d73-3ce7-483b-86d2-4c4b9302d11b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:51.097804 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22f19d73-3ce7-483b-86d2-4c4b9302d11b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:51.098244 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-22f19d73-3ce7-483b-86d2-4c4b9302d11b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:51.245488 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-22f19d73-3ce7-483b-86d2-4c4b9302d11b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:51.255195 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-22f19d73-3ce7-483b-86d2-4c4b9302d11b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:51.256702 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-22f19d73-3ce7-483b-86d2-4c4b9302d11b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:51.257879 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-22f19d73-3ce7-483b-86d2-4c4b9302d11b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1749 microversion: 2.20 time: 0.173187 Nov 12 02:30:51.258444 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 401/829] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:51 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:52.277769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c4ab04a1-5aee-4b7f-bea8-668605d89546 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:52.278367 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c4ab04a1-5aee-4b7f-bea8-668605d89546 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:52.285532 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c4ab04a1-5aee-4b7f-bea8-668605d89546 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:52.285992 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c4ab04a1-5aee-4b7f-bea8-668605d89546 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:52.286855 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c4ab04a1-5aee-4b7f-bea8-668605d89546 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:52.287392 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c4ab04a1-5aee-4b7f-bea8-668605d89546 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:52.442377 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c4ab04a1-5aee-4b7f-bea8-668605d89546 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:52.450632 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c4ab04a1-5aee-4b7f-bea8-668605d89546 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:52.452158 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c4ab04a1-5aee-4b7f-bea8-668605d89546 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:52.453328 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c4ab04a1-5aee-4b7f-bea8-668605d89546 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1751 microversion: 2.20 time: 0.180742 Nov 12 02:30:52.453882 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 429/830] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:52 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:30:53.472642 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ece8f64c-663a-45e4-a30e-fa24a8a33f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:53.473212 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ece8f64c-663a-45e4-a30e-fa24a8a33f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:53.479721 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ece8f64c-663a-45e4-a30e-fa24a8a33f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:53.480123 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ece8f64c-663a-45e4-a30e-fa24a8a33f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:53.480924 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ece8f64c-663a-45e4-a30e-fa24a8a33f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:53.481377 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ece8f64c-663a-45e4-a30e-fa24a8a33f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:53.620024 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ece8f64c-663a-45e4-a30e-fa24a8a33f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:53.629083 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ece8f64c-663a-45e4-a30e-fa24a8a33f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:53.630603 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ece8f64c-663a-45e4-a30e-fa24a8a33f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:53.631786 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ece8f64c-663a-45e4-a30e-fa24a8a33f0e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1751 microversion: 2.20 time: 0.163136 Nov 12 02:30:53.632373 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 402/831] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:53 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:54.651752 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f8dd7960-bbb9-49ee-a063-691bfb746271 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:54.652356 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f8dd7960-bbb9-49ee-a063-691bfb746271 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:54.658622 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f8dd7960-bbb9-49ee-a063-691bfb746271 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:54.659089 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f8dd7960-bbb9-49ee-a063-691bfb746271 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:54.659864 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f8dd7960-bbb9-49ee-a063-691bfb746271 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:54.660968 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f8dd7960-bbb9-49ee-a063-691bfb746271 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:54.793829 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f8dd7960-bbb9-49ee-a063-691bfb746271 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:54.802735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f8dd7960-bbb9-49ee-a063-691bfb746271 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:54.804246 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f8dd7960-bbb9-49ee-a063-691bfb746271 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:54.805425 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f8dd7960-bbb9-49ee-a063-691bfb746271 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1751 microversion: 2.20 time: 0.157639 Nov 12 02:30:54.805990 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 430/832] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:54 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:55.824345 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b91daa1c-941a-4d13-abdc-33f5797c05eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:55.825064 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b91daa1c-941a-4d13-abdc-33f5797c05eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:55.831677 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b91daa1c-941a-4d13-abdc-33f5797c05eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:55.832673 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b91daa1c-941a-4d13-abdc-33f5797c05eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:55.833491 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b91daa1c-941a-4d13-abdc-33f5797c05eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:55.833923 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b91daa1c-941a-4d13-abdc-33f5797c05eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:55.980585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b91daa1c-941a-4d13-abdc-33f5797c05eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:55.990267 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b91daa1c-941a-4d13-abdc-33f5797c05eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:55.991808 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b91daa1c-941a-4d13-abdc-33f5797c05eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:55.993224 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b91daa1c-941a-4d13-abdc-33f5797c05eb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1751 microversion: 2.20 time: 0.172765 Nov 12 02:30:55.993779 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 403/833] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:55 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:57.011865 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1a172c8f-408f-4965-ace9-7625d274351f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:57.012442 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1a172c8f-408f-4965-ace9-7625d274351f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:57.019060 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a172c8f-408f-4965-ace9-7625d274351f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:57.019512 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a172c8f-408f-4965-ace9-7625d274351f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:57.020301 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a172c8f-408f-4965-ace9-7625d274351f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:57.020818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a172c8f-408f-4965-ace9-7625d274351f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:57.167265 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1a172c8f-408f-4965-ace9-7625d274351f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:57.179953 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1a172c8f-408f-4965-ace9-7625d274351f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:57.182211 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1a172c8f-408f-4965-ace9-7625d274351f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:57.184066 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1a172c8f-408f-4965-ace9-7625d274351f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1751 microversion: 2.20 time: 0.175956 Nov 12 02:30:57.184963 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 431/834] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:57 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:58.207745 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d6c065eb-24a7-4b5a-a49c-f3d976d6d3b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:58.208347 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d6c065eb-24a7-4b5a-a49c-f3d976d6d3b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:58.215657 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6c065eb-24a7-4b5a-a49c-f3d976d6d3b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:58.216335 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6c065eb-24a7-4b5a-a49c-f3d976d6d3b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:58.217279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6c065eb-24a7-4b5a-a49c-f3d976d6d3b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:58.217803 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d6c065eb-24a7-4b5a-a49c-f3d976d6d3b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:58.387467 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d6c065eb-24a7-4b5a-a49c-f3d976d6d3b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:58.402907 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d6c065eb-24a7-4b5a-a49c-f3d976d6d3b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:58.404410 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d6c065eb-24a7-4b5a-a49c-f3d976d6d3b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:58.405966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d6c065eb-24a7-4b5a-a49c-f3d976d6d3b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1751 microversion: 2.20 time: 0.202320 Nov 12 02:30:58.407185 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 404/835] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:58 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:30:59.429791 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0fbea627-8d99-4576-9665-55bb27e330ac tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:30:59.430565 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0fbea627-8d99-4576-9665-55bb27e330ac tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:30:59.436867 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0fbea627-8d99-4576-9665-55bb27e330ac tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:59.437315 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0fbea627-8d99-4576-9665-55bb27e330ac tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:59.438097 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0fbea627-8d99-4576-9665-55bb27e330ac tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:30:59.438559 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0fbea627-8d99-4576-9665-55bb27e330ac tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:30:59.585515 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0fbea627-8d99-4576-9665-55bb27e330ac tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:59.596656 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0fbea627-8d99-4576-9665-55bb27e330ac tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:59.598265 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0fbea627-8d99-4576-9665-55bb27e330ac tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:30:59.599453 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0fbea627-8d99-4576-9665-55bb27e330ac tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1751 microversion: 2.20 time: 0.175284 Nov 12 02:30:59.600011 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 432/836] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:30:59 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:00.618655 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f7b05e9b-5d92-420e-a8fa-758118a6d987 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:00.619256 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f7b05e9b-5d92-420e-a8fa-758118a6d987 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:00.626250 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7b05e9b-5d92-420e-a8fa-758118a6d987 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:00.626719 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7b05e9b-5d92-420e-a8fa-758118a6d987 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:00.627688 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7b05e9b-5d92-420e-a8fa-758118a6d987 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:00.628312 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f7b05e9b-5d92-420e-a8fa-758118a6d987 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:00.861933 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f7b05e9b-5d92-420e-a8fa-758118a6d987 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:00.874184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f7b05e9b-5d92-420e-a8fa-758118a6d987 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:00.876635 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f7b05e9b-5d92-420e-a8fa-758118a6d987 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:00.878416 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f7b05e9b-5d92-420e-a8fa-758118a6d987 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.263724 Nov 12 02:31:00.881211 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 405/837] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:00 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:31:01.907995 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1d2ee347-6512-4dec-84af-924f0d9d0386 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:01.909025 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1d2ee347-6512-4dec-84af-924f0d9d0386 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:01.919897 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1d2ee347-6512-4dec-84af-924f0d9d0386 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:01.920516 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1d2ee347-6512-4dec-84af-924f0d9d0386 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:01.921787 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1d2ee347-6512-4dec-84af-924f0d9d0386 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:01.922338 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1d2ee347-6512-4dec-84af-924f0d9d0386 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:02.094157 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1d2ee347-6512-4dec-84af-924f0d9d0386 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:02.107392 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1d2ee347-6512-4dec-84af-924f0d9d0386 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:02.108930 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1d2ee347-6512-4dec-84af-924f0d9d0386 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:02.110405 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1d2ee347-6512-4dec-84af-924f0d9d0386 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.208871 Nov 12 02:31:02.111132 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 433/838] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:01 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:03.135218 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e35ef4d1-318a-4f57-9220-6a8745417d18 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:03.135887 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e35ef4d1-318a-4f57-9220-6a8745417d18 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:03.142903 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e35ef4d1-318a-4f57-9220-6a8745417d18 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:03.143612 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e35ef4d1-318a-4f57-9220-6a8745417d18 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:03.144419 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e35ef4d1-318a-4f57-9220-6a8745417d18 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:03.144859 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e35ef4d1-318a-4f57-9220-6a8745417d18 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:03.327740 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e35ef4d1-318a-4f57-9220-6a8745417d18 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:03.337318 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e35ef4d1-318a-4f57-9220-6a8745417d18 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:03.339320 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e35ef4d1-318a-4f57-9220-6a8745417d18 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:03.341086 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e35ef4d1-318a-4f57-9220-6a8745417d18 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.209553 Nov 12 02:31:03.341880 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 406/839] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:03 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:04.365757 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-12fb1632-e219-4c69-aea4-e5520ba259d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:04.366367 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-12fb1632-e219-4c69-aea4-e5520ba259d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:04.378494 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12fb1632-e219-4c69-aea4-e5520ba259d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:04.380258 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12fb1632-e219-4c69-aea4-e5520ba259d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:04.381751 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12fb1632-e219-4c69-aea4-e5520ba259d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:04.382375 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12fb1632-e219-4c69-aea4-e5520ba259d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:04.644952 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-12fb1632-e219-4c69-aea4-e5520ba259d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:04.658011 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-12fb1632-e219-4c69-aea4-e5520ba259d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:04.661354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-12fb1632-e219-4c69-aea4-e5520ba259d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:04.663277 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-12fb1632-e219-4c69-aea4-e5520ba259d1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.301549 Nov 12 02:31:04.664285 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 434/840] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:04 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:05.701412 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4b33e3a4-9b25-4ea8-828f-8b28237bf9e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:05.702105 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4b33e3a4-9b25-4ea8-828f-8b28237bf9e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:05.708960 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4b33e3a4-9b25-4ea8-828f-8b28237bf9e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:05.709339 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4b33e3a4-9b25-4ea8-828f-8b28237bf9e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:05.710131 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4b33e3a4-9b25-4ea8-828f-8b28237bf9e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:05.710568 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4b33e3a4-9b25-4ea8-828f-8b28237bf9e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:05.863422 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4b33e3a4-9b25-4ea8-828f-8b28237bf9e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:05.873513 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4b33e3a4-9b25-4ea8-828f-8b28237bf9e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:05.875670 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4b33e3a4-9b25-4ea8-828f-8b28237bf9e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:05.876980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4b33e3a4-9b25-4ea8-828f-8b28237bf9e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.180180 Nov 12 02:31:05.877647 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 407/841] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:05 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:06.897091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ba599c0a-d11b-45e5-9acf-941e40de3543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:06.897912 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ba599c0a-d11b-45e5-9acf-941e40de3543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:06.914373 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ba599c0a-d11b-45e5-9acf-941e40de3543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:06.914373 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ba599c0a-d11b-45e5-9acf-941e40de3543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:06.915756 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ba599c0a-d11b-45e5-9acf-941e40de3543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:06.916206 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ba599c0a-d11b-45e5-9acf-941e40de3543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:07.086152 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ba599c0a-d11b-45e5-9acf-941e40de3543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:07.103465 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ba599c0a-d11b-45e5-9acf-941e40de3543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:07.105230 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ba599c0a-d11b-45e5-9acf-941e40de3543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:07.115754 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ba599c0a-d11b-45e5-9acf-941e40de3543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.213104 Nov 12 02:31:07.118651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 435/842] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:06 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:08.136930 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-662b7e98-408a-40b8-a230-8d26dae9a14b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:08.137579 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-662b7e98-408a-40b8-a230-8d26dae9a14b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:08.143660 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-662b7e98-408a-40b8-a230-8d26dae9a14b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:08.144364 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-662b7e98-408a-40b8-a230-8d26dae9a14b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:08.145149 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-662b7e98-408a-40b8-a230-8d26dae9a14b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:08.145582 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-662b7e98-408a-40b8-a230-8d26dae9a14b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:08.298520 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-662b7e98-408a-40b8-a230-8d26dae9a14b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:08.312144 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-662b7e98-408a-40b8-a230-8d26dae9a14b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:08.313661 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-662b7e98-408a-40b8-a230-8d26dae9a14b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:08.316856 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-662b7e98-408a-40b8-a230-8d26dae9a14b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.181918 Nov 12 02:31:08.316856 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 408/843] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:08 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:09.334443 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8a51ac44-aa9c-45c1-8e19-0d68e42131a6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:09.335145 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8a51ac44-aa9c-45c1-8e19-0d68e42131a6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:09.341631 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8a51ac44-aa9c-45c1-8e19-0d68e42131a6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:09.342336 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8a51ac44-aa9c-45c1-8e19-0d68e42131a6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:09.343455 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8a51ac44-aa9c-45c1-8e19-0d68e42131a6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:09.343892 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8a51ac44-aa9c-45c1-8e19-0d68e42131a6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:09.806277 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8a51ac44-aa9c-45c1-8e19-0d68e42131a6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:09.817577 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8a51ac44-aa9c-45c1-8e19-0d68e42131a6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:09.822734 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8a51ac44-aa9c-45c1-8e19-0d68e42131a6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:09.824294 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8a51ac44-aa9c-45c1-8e19-0d68e42131a6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.494241 Nov 12 02:31:09.835724 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 436/844] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:09 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:10.843120 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6edef613-edae-44aa-8c25-caf9aa9b08fb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:10.843869 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6edef613-edae-44aa-8c25-caf9aa9b08fb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:10.851260 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6edef613-edae-44aa-8c25-caf9aa9b08fb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:10.851853 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6edef613-edae-44aa-8c25-caf9aa9b08fb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:10.852737 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6edef613-edae-44aa-8c25-caf9aa9b08fb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:10.853264 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6edef613-edae-44aa-8c25-caf9aa9b08fb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:11.090574 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6edef613-edae-44aa-8c25-caf9aa9b08fb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:11.122054 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6edef613-edae-44aa-8c25-caf9aa9b08fb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:11.123588 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6edef613-edae-44aa-8c25-caf9aa9b08fb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:11.124790 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6edef613-edae-44aa-8c25-caf9aa9b08fb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.285693 Nov 12 02:31:11.125286 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 409/845] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:10 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:12.143984 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-be3a44b2-c682-4322-b002-29090299e04f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:12.144812 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-be3a44b2-c682-4322-b002-29090299e04f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:12.151909 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-be3a44b2-c682-4322-b002-29090299e04f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:12.152037 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-be3a44b2-c682-4322-b002-29090299e04f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:12.153012 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-be3a44b2-c682-4322-b002-29090299e04f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:12.153598 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-be3a44b2-c682-4322-b002-29090299e04f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:12.332799 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-be3a44b2-c682-4322-b002-29090299e04f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:12.350362 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-be3a44b2-c682-4322-b002-29090299e04f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:12.352110 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-be3a44b2-c682-4322-b002-29090299e04f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:12.353481 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-be3a44b2-c682-4322-b002-29090299e04f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.213188 Nov 12 02:31:12.354341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 437/846] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:12 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:13.039006 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2047173271", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:31:13.303414 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] validate_networks() for None {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:31:13.380106 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3c5faa0e-ef68-4a8d-a19a-6680c512b1c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:13.380734 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3c5faa0e-ef68-4a8d-a19a-6680c512b1c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:13.392211 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3c5faa0e-ef68-4a8d-a19a-6680c512b1c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:13.395282 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3c5faa0e-ef68-4a8d-a19a-6680c512b1c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:13.396336 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3c5faa0e-ef68-4a8d-a19a-6680c512b1c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:13.404444 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3c5faa0e-ef68-4a8d-a19a-6680c512b1c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:13.748029 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3c5faa0e-ef68-4a8d-a19a-6680c512b1c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:13.775208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3c5faa0e-ef68-4a8d-a19a-6680c512b1c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:13.776909 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3c5faa0e-ef68-4a8d-a19a-6680c512b1c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:13.778142 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3c5faa0e-ef68-4a8d-a19a-6680c512b1c2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.403006 Nov 12 02:31:13.778739 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 438/847] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:13 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:14.089051 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:31:14.091492 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:31:14.092076 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:31:14.092638 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:31:14.093112 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:31:14.102548 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:14.103409 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:14.104428 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:14.105067 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:14.125186 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Getting quotas for project a876e3d7f3a34cf39a0e1b64acd65553. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:31:14.131362 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Getting quotas for user 0f2fab4debff4bd7a577cff7a73e6d73 and project a876e3d7f3a34cf39a0e1b64acd65553. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:31:14.144018 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:31:14.146700 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:31:14.204952 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-46d72ca2-4503-4d30-80b4-3b9b4c0dfcdf tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169463 Nov 12 02:31:14.207056 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 410/848] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:31:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 12 02:31:14.220283 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3bf7c41b-6878-40e0-ab9b-ee42d7d51e32 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:14.221571 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3bf7c41b-6878-40e0-ab9b-ee42d7d51e32 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:14.312541 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3bf7c41b-6878-40e0-ab9b-ee42d7d51e32 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:14.325617 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3bf7c41b-6878-40e0-ab9b-ee42d7d51e32 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1215 microversion: 2.1 time: 0.110929 Nov 12 02:31:14.327888 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 439/849] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:14 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:14.797670 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f97dd120-9d3c-47cd-b3c9-3df538bc970d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:14.798605 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f97dd120-9d3c-47cd-b3c9-3df538bc970d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:14.806719 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f97dd120-9d3c-47cd-b3c9-3df538bc970d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:14.807422 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f97dd120-9d3c-47cd-b3c9-3df538bc970d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:14.808460 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f97dd120-9d3c-47cd-b3c9-3df538bc970d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:14.808901 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f97dd120-9d3c-47cd-b3c9-3df538bc970d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:15.007104 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f97dd120-9d3c-47cd-b3c9-3df538bc970d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:15.016725 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f97dd120-9d3c-47cd-b3c9-3df538bc970d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:15.018642 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f97dd120-9d3c-47cd-b3c9-3df538bc970d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:15.020218 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f97dd120-9d3c-47cd-b3c9-3df538bc970d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.227113 Nov 12 02:31:15.020929 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 411/850] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:14 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:15.344486 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-22f08f97-eab0-4c99-abe4-cef60ef4a146 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:15.345957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-22f08f97-eab0-4c99-abe4-cef60ef4a146 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:15.363752 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-22f08f97-eab0-4c99-abe4-cef60ef4a146 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:15.364314 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-22f08f97-eab0-4c99-abe4-cef60ef4a146 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:15.365105 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-22f08f97-eab0-4c99-abe4-cef60ef4a146 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:15.365530 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-22f08f97-eab0-4c99-abe4-cef60ef4a146 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:15.435684 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-22f08f97-eab0-4c99-abe4-cef60ef4a146 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:15.450543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-22f08f97-eab0-4c99-abe4-cef60ef4a146 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1219 microversion: 2.1 time: 0.110052 Nov 12 02:31:15.458837 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 440/851] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:15 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:16.062462 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-60cfa0cc-eac6-4a22-a054-6b22ca399d23 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:16.063238 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-60cfa0cc-eac6-4a22-a054-6b22ca399d23 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:16.071631 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60cfa0cc-eac6-4a22-a054-6b22ca399d23 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:16.074133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60cfa0cc-eac6-4a22-a054-6b22ca399d23 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:16.074133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60cfa0cc-eac6-4a22-a054-6b22ca399d23 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:16.074133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-60cfa0cc-eac6-4a22-a054-6b22ca399d23 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:16.241978 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-60cfa0cc-eac6-4a22-a054-6b22ca399d23 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:16.257696 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-60cfa0cc-eac6-4a22-a054-6b22ca399d23 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:16.259957 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-60cfa0cc-eac6-4a22-a054-6b22ca399d23 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:16.261157 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-60cfa0cc-eac6-4a22-a054-6b22ca399d23 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.215526 Nov 12 02:31:16.272945 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 412/852] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:16 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:16.470429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7043110d-2bb7-4283-a56e-cdb2d5b11e55 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:16.473485 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7043110d-2bb7-4283-a56e-cdb2d5b11e55 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:16.480817 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7043110d-2bb7-4283-a56e-cdb2d5b11e55 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:16.481432 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7043110d-2bb7-4283-a56e-cdb2d5b11e55 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:16.482404 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7043110d-2bb7-4283-a56e-cdb2d5b11e55 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:16.482924 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7043110d-2bb7-4283-a56e-cdb2d5b11e55 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:16.554490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7043110d-2bb7-4283-a56e-cdb2d5b11e55 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:16.563785 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7043110d-2bb7-4283-a56e-cdb2d5b11e55 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1219 microversion: 2.1 time: 0.098043 Nov 12 02:31:16.574923 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 441/853] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:16 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:31:17.281616 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-82157061-790f-4b8e-ad01-26f7bc2c5c85 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:17.282369 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-82157061-790f-4b8e-ad01-26f7bc2c5c85 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:17.303466 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82157061-790f-4b8e-ad01-26f7bc2c5c85 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:17.304080 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82157061-790f-4b8e-ad01-26f7bc2c5c85 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:17.305168 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82157061-790f-4b8e-ad01-26f7bc2c5c85 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:17.305703 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82157061-790f-4b8e-ad01-26f7bc2c5c85 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:17.455241 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-82157061-790f-4b8e-ad01-26f7bc2c5c85 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:17.475087 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-82157061-790f-4b8e-ad01-26f7bc2c5c85 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:17.478175 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-82157061-790f-4b8e-ad01-26f7bc2c5c85 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:17.481589 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-82157061-790f-4b8e-ad01-26f7bc2c5c85 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.203799 Nov 12 02:31:17.487493 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 413/854] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:17 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:17.583725 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8a192e6a-cc69-4d4d-a9f3-855ecc9a24ec tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:17.584997 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8a192e6a-cc69-4d4d-a9f3-855ecc9a24ec tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:17.592357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8a192e6a-cc69-4d4d-a9f3-855ecc9a24ec tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:17.592843 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8a192e6a-cc69-4d4d-a9f3-855ecc9a24ec tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:17.593641 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8a192e6a-cc69-4d4d-a9f3-855ecc9a24ec tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:17.594218 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8a192e6a-cc69-4d4d-a9f3-855ecc9a24ec tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:17.689043 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8a192e6a-cc69-4d4d-a9f3-855ecc9a24ec tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:17.707566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8a192e6a-cc69-4d4d-a9f3-855ecc9a24ec tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1219 microversion: 2.1 time: 0.129315 Nov 12 02:31:17.708463 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 442/855] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:17 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:18.502046 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8332cc88-e303-42cf-9ff2-277a46cafa42 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:18.502873 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8332cc88-e303-42cf-9ff2-277a46cafa42 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:18.510082 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8332cc88-e303-42cf-9ff2-277a46cafa42 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:18.510535 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8332cc88-e303-42cf-9ff2-277a46cafa42 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:18.511378 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8332cc88-e303-42cf-9ff2-277a46cafa42 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:18.511814 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8332cc88-e303-42cf-9ff2-277a46cafa42 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:18.675818 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8332cc88-e303-42cf-9ff2-277a46cafa42 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:18.684395 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8332cc88-e303-42cf-9ff2-277a46cafa42 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:18.685953 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8332cc88-e303-42cf-9ff2-277a46cafa42 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:18.687100 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8332cc88-e303-42cf-9ff2-277a46cafa42 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.189372 Nov 12 02:31:18.687710 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 414/856] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:18 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:31:18.724059 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c5491b4e-fdb5-4e99-91e4-eaf4675c62ad tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:18.724674 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c5491b4e-fdb5-4e99-91e4-eaf4675c62ad tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:18.731815 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c5491b4e-fdb5-4e99-91e4-eaf4675c62ad tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:18.732284 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c5491b4e-fdb5-4e99-91e4-eaf4675c62ad tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:18.733088 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c5491b4e-fdb5-4e99-91e4-eaf4675c62ad tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:18.733537 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c5491b4e-fdb5-4e99-91e4-eaf4675c62ad tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:18.802344 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c5491b4e-fdb5-4e99-91e4-eaf4675c62ad tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:18.810267 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c5491b4e-fdb5-4e99-91e4-eaf4675c62ad tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1219 microversion: 2.1 time: 0.090523 Nov 12 02:31:18.810885 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 443/857] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:18 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:19.710771 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-beaa6aa7-a828-4c5c-adfd-fc323650fb65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:19.711391 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-beaa6aa7-a828-4c5c-adfd-fc323650fb65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:19.718111 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-beaa6aa7-a828-4c5c-adfd-fc323650fb65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:19.718557 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-beaa6aa7-a828-4c5c-adfd-fc323650fb65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:19.719383 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-beaa6aa7-a828-4c5c-adfd-fc323650fb65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:19.719855 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-beaa6aa7-a828-4c5c-adfd-fc323650fb65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:19.828328 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-50aab1fc-5084-47b0-a224-373db3177085 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:19.829228 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-50aab1fc-5084-47b0-a224-373db3177085 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:19.837463 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-50aab1fc-5084-47b0-a224-373db3177085 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:19.837991 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-50aab1fc-5084-47b0-a224-373db3177085 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:19.838964 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-50aab1fc-5084-47b0-a224-373db3177085 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:19.845515 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-50aab1fc-5084-47b0-a224-373db3177085 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:19.877049 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-beaa6aa7-a828-4c5c-adfd-fc323650fb65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:19.886611 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-beaa6aa7-a828-4c5c-adfd-fc323650fb65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:19.888463 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-beaa6aa7-a828-4c5c-adfd-fc323650fb65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:19.889805 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-beaa6aa7-a828-4c5c-adfd-fc323650fb65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.187047 Nov 12 02:31:19.890541 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 415/858] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:19 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:19.947658 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-50aab1fc-5084-47b0-a224-373db3177085 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:19.955820 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-50aab1fc-5084-47b0-a224-373db3177085 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1219 microversion: 2.1 time: 0.131646 Nov 12 02:31:19.956566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 444/859] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:19 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:20.975348 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-bf265214-7f68-440b-800b-ff7a17d3e687 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:20.976086 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-bf265214-7f68-440b-800b-ff7a17d3e687 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:20.985492 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bf265214-7f68-440b-800b-ff7a17d3e687 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:20.986240 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bf265214-7f68-440b-800b-ff7a17d3e687 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:20.987588 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bf265214-7f68-440b-800b-ff7a17d3e687 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:20.988326 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bf265214-7f68-440b-800b-ff7a17d3e687 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:21.057464 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-bf265214-7f68-440b-800b-ff7a17d3e687 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:21.064657 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-bf265214-7f68-440b-800b-ff7a17d3e687 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1219 microversion: 2.1 time: 0.094752 Nov 12 02:31:21.065241 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 445/860] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:20 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:21.112442 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-de61e2a2-0b12-444a-9eca-7eba64ccbd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:21.113100 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-de61e2a2-0b12-444a-9eca-7eba64ccbd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:21.120586 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-de61e2a2-0b12-444a-9eca-7eba64ccbd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:21.121034 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-de61e2a2-0b12-444a-9eca-7eba64ccbd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:21.121802 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-de61e2a2-0b12-444a-9eca-7eba64ccbd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:21.122234 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-de61e2a2-0b12-444a-9eca-7eba64ccbd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:21.264192 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-de61e2a2-0b12-444a-9eca-7eba64ccbd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:21.273512 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-de61e2a2-0b12-444a-9eca-7eba64ccbd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:21.275102 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-de61e2a2-0b12-444a-9eca-7eba64ccbd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:21.276270 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-de61e2a2-0b12-444a-9eca-7eba64ccbd3b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.371218 Nov 12 02:31:21.276860 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 416/861] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:20 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:22.081067 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6a256b30-bf49-416b-9189-97512dfb389a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:22.081861 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6a256b30-bf49-416b-9189-97512dfb389a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:22.088354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6a256b30-bf49-416b-9189-97512dfb389a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:22.089001 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6a256b30-bf49-416b-9189-97512dfb389a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:22.089830 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6a256b30-bf49-416b-9189-97512dfb389a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:22.090286 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6a256b30-bf49-416b-9189-97512dfb389a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:22.167302 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6a256b30-bf49-416b-9189-97512dfb389a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:22.174729 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6a256b30-bf49-416b-9189-97512dfb389a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1267 microversion: 2.1 time: 0.097249 Nov 12 02:31:22.175917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 446/862] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:22 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:22.303843 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-acdddd25-20a7-4d7a-8d7a-4b3bb6c0784e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:22.304973 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-acdddd25-20a7-4d7a-8d7a-4b3bb6c0784e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:22.312520 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-acdddd25-20a7-4d7a-8d7a-4b3bb6c0784e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:22.312975 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-acdddd25-20a7-4d7a-8d7a-4b3bb6c0784e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:22.313766 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-acdddd25-20a7-4d7a-8d7a-4b3bb6c0784e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:22.314203 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-acdddd25-20a7-4d7a-8d7a-4b3bb6c0784e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:22.530490 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-acdddd25-20a7-4d7a-8d7a-4b3bb6c0784e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:22.539644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-acdddd25-20a7-4d7a-8d7a-4b3bb6c0784e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:22.541140 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-acdddd25-20a7-4d7a-8d7a-4b3bb6c0784e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:22.542345 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-acdddd25-20a7-4d7a-8d7a-4b3bb6c0784e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.245364 Nov 12 02:31:22.542928 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 417/863] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:22 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:23.192316 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-dce4b5ae-f9d2-473e-b728-85caa5ddfb5b tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:23.192936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-dce4b5ae-f9d2-473e-b728-85caa5ddfb5b tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:23.200280 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dce4b5ae-f9d2-473e-b728-85caa5ddfb5b tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:23.200836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dce4b5ae-f9d2-473e-b728-85caa5ddfb5b tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:23.201860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dce4b5ae-f9d2-473e-b728-85caa5ddfb5b tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:23.202611 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dce4b5ae-f9d2-473e-b728-85caa5ddfb5b tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:23.277615 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-dce4b5ae-f9d2-473e-b728-85caa5ddfb5b tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:23.285175 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-dce4b5ae-f9d2-473e-b728-85caa5ddfb5b tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1273 microversion: 2.1 time: 0.097018 Nov 12 02:31:23.285752 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 447/864] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:23 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1273 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:23.562728 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-eed356d7-c006-4b39-b8cc-7da618309d51 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:23.563990 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-eed356d7-c006-4b39-b8cc-7da618309d51 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:23.572090 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eed356d7-c006-4b39-b8cc-7da618309d51 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:23.572939 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eed356d7-c006-4b39-b8cc-7da618309d51 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:23.573902 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eed356d7-c006-4b39-b8cc-7da618309d51 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:23.574330 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eed356d7-c006-4b39-b8cc-7da618309d51 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:23.726420 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-eed356d7-c006-4b39-b8cc-7da618309d51 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:23.735773 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-eed356d7-c006-4b39-b8cc-7da618309d51 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:23.737274 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-eed356d7-c006-4b39-b8cc-7da618309d51 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:23.739053 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-eed356d7-c006-4b39-b8cc-7da618309d51 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.181479 Nov 12 02:31:23.740008 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 418/865] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:23 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:24.132587 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-ba79396f-cb59-4225-b6bd-3ba543197d3e req-fd86510e-ef4b-493e-b97a-02f59e472c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce1e3b55-ec7c-4307-98ec-25aab7b162c3", "tag": "44b41f6f-a0e0-4053-88d3-7b3c84082626"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:31:24.134385 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:31:24.134385 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:31:24.155545 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-ba79396f-cb59-4225-b6bd-3ba543197d3e req-fd86510e-ef4b-493e-b97a-02f59e472c65 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:24.156016 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-ba79396f-cb59-4225-b6bd-3ba543197d3e req-fd86510e-ef4b-493e-b97a-02f59e472c65 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:24.181441 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-ba79396f-cb59-4225-b6bd-3ba543197d3e req-fd86510e-ef4b-493e-b97a-02f59e472c65 service nova] Creating event network-changed:44b41f6f-a0e0-4053-88d3-7b3c84082626 for instance ce1e3b55-ec7c-4307-98ec-25aab7b162c3 on hv-cinder-80857 Nov 12 02:31:24.187212 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-ba79396f-cb59-4225-b6bd-3ba543197d3e req-fd86510e-ef4b-493e-b97a-02f59e472c65 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059749 Nov 12 02:31:24.187823 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 448/866] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:31:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:31:24.307433 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9cdb315a-96f4-47ae-a861-eabf7bf891bb tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:24.309412 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9cdb315a-96f4-47ae-a861-eabf7bf891bb tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:24.316447 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9cdb315a-96f4-47ae-a861-eabf7bf891bb tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:24.317090 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9cdb315a-96f4-47ae-a861-eabf7bf891bb tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:24.317898 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9cdb315a-96f4-47ae-a861-eabf7bf891bb tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:24.318333 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9cdb315a-96f4-47ae-a861-eabf7bf891bb tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:24.499708 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9cdb315a-96f4-47ae-a861-eabf7bf891bb tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:24.507581 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9cdb315a-96f4-47ae-a861-eabf7bf891bb tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1315 microversion: 2.1 time: 0.208470 Nov 12 02:31:24.508317 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 419/867] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:24 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:24.764860 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9680918d-def3-47af-80e8-08e1496adbc3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:24.765562 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9680918d-def3-47af-80e8-08e1496adbc3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:24.772216 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9680918d-def3-47af-80e8-08e1496adbc3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:24.772669 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9680918d-def3-47af-80e8-08e1496adbc3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:24.773463 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9680918d-def3-47af-80e8-08e1496adbc3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:24.773898 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9680918d-def3-47af-80e8-08e1496adbc3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:24.906793 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9680918d-def3-47af-80e8-08e1496adbc3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:24.916171 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9680918d-def3-47af-80e8-08e1496adbc3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:24.917817 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9680918d-def3-47af-80e8-08e1496adbc3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:24.919060 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9680918d-def3-47af-80e8-08e1496adbc3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.158768 Nov 12 02:31:24.919638 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 449/868] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:24 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:25.525821 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ad0963f7-fae5-4bd9-bc63-526bbafc4588 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:25.526366 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ad0963f7-fae5-4bd9-bc63-526bbafc4588 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:25.532884 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ad0963f7-fae5-4bd9-bc63-526bbafc4588 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:25.533330 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ad0963f7-fae5-4bd9-bc63-526bbafc4588 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:25.534123 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ad0963f7-fae5-4bd9-bc63-526bbafc4588 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:25.535218 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ad0963f7-fae5-4bd9-bc63-526bbafc4588 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:25.676636 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ad0963f7-fae5-4bd9-bc63-526bbafc4588 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:25.686546 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ad0963f7-fae5-4bd9-bc63-526bbafc4588 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1315 microversion: 2.1 time: 0.164958 Nov 12 02:31:25.687192 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 420/869] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:25 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:25.937125 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-000812d4-7972-46c7-95d4-3cc03bfc088f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:25.937722 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-000812d4-7972-46c7-95d4-3cc03bfc088f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:25.945151 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-000812d4-7972-46c7-95d4-3cc03bfc088f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:25.945601 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-000812d4-7972-46c7-95d4-3cc03bfc088f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:25.946410 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-000812d4-7972-46c7-95d4-3cc03bfc088f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:25.946863 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-000812d4-7972-46c7-95d4-3cc03bfc088f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:26.088935 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-000812d4-7972-46c7-95d4-3cc03bfc088f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:26.097544 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-000812d4-7972-46c7-95d4-3cc03bfc088f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:26.099160 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-000812d4-7972-46c7-95d4-3cc03bfc088f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:26.100334 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-000812d4-7972-46c7-95d4-3cc03bfc088f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.166893 Nov 12 02:31:26.101103 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 450/870] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:25 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:26.703806 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dcedbad2-2de9-453a-8f4e-9bced781fd39 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:26.704415 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dcedbad2-2de9-453a-8f4e-9bced781fd39 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:26.710895 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dcedbad2-2de9-453a-8f4e-9bced781fd39 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:26.711352 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dcedbad2-2de9-453a-8f4e-9bced781fd39 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:26.712139 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dcedbad2-2de9-453a-8f4e-9bced781fd39 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:26.712570 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dcedbad2-2de9-453a-8f4e-9bced781fd39 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:26.857944 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dcedbad2-2de9-453a-8f4e-9bced781fd39 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:26.865347 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dcedbad2-2de9-453a-8f4e-9bced781fd39 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1315 microversion: 2.1 time: 0.165254 Nov 12 02:31:26.865912 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 421/871] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:26 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:27.120688 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b08e5c4a-0bfb-44f9-8eb9-99c6c234c927 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:27.121158 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b08e5c4a-0bfb-44f9-8eb9-99c6c234c927 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:27.129178 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b08e5c4a-0bfb-44f9-8eb9-99c6c234c927 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:27.130449 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b08e5c4a-0bfb-44f9-8eb9-99c6c234c927 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:27.131626 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b08e5c4a-0bfb-44f9-8eb9-99c6c234c927 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:27.132192 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b08e5c4a-0bfb-44f9-8eb9-99c6c234c927 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:27.311836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b08e5c4a-0bfb-44f9-8eb9-99c6c234c927 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:27.320551 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b08e5c4a-0bfb-44f9-8eb9-99c6c234c927 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:27.322075 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b08e5c4a-0bfb-44f9-8eb9-99c6c234c927 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:27.323314 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b08e5c4a-0bfb-44f9-8eb9-99c6c234c927 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.207781 Nov 12 02:31:27.323894 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 451/872] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:27 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:27.882635 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e1483869-1537-4eae-8033-53f7451b7657 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:27.883327 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e1483869-1537-4eae-8033-53f7451b7657 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:27.889753 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e1483869-1537-4eae-8033-53f7451b7657 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:27.890230 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e1483869-1537-4eae-8033-53f7451b7657 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:27.891125 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e1483869-1537-4eae-8033-53f7451b7657 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:27.891552 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e1483869-1537-4eae-8033-53f7451b7657 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:28.034455 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e1483869-1537-4eae-8033-53f7451b7657 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:28.042085 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e1483869-1537-4eae-8033-53f7451b7657 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1315 microversion: 2.1 time: 0.163044 Nov 12 02:31:28.042774 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 422/873] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:27 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:28.341813 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b4b5addb-be44-4615-aade-53271e0f49e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:28.342418 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b4b5addb-be44-4615-aade-53271e0f49e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:28.349328 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4b5addb-be44-4615-aade-53271e0f49e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:28.349836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4b5addb-be44-4615-aade-53271e0f49e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:28.350638 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4b5addb-be44-4615-aade-53271e0f49e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:28.351110 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4b5addb-be44-4615-aade-53271e0f49e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:28.509671 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b4b5addb-be44-4615-aade-53271e0f49e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:28.518399 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b4b5addb-be44-4615-aade-53271e0f49e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:28.520636 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b4b5addb-be44-4615-aade-53271e0f49e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:28.521818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b4b5addb-be44-4615-aade-53271e0f49e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.184302 Nov 12 02:31:28.522400 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 452/874] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:28 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:29.059600 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-40f51123-c3ba-47e5-9efd-4681d22660a7 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:29.060192 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-40f51123-c3ba-47e5-9efd-4681d22660a7 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:29.067440 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-40f51123-c3ba-47e5-9efd-4681d22660a7 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:29.067894 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-40f51123-c3ba-47e5-9efd-4681d22660a7 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:29.069732 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-40f51123-c3ba-47e5-9efd-4681d22660a7 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:29.070182 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-40f51123-c3ba-47e5-9efd-4681d22660a7 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:29.212597 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-40f51123-c3ba-47e5-9efd-4681d22660a7 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:29.219785 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-40f51123-c3ba-47e5-9efd-4681d22660a7 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1315 microversion: 2.1 time: 0.164455 Nov 12 02:31:29.220358 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 423/875] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:29 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:29.540449 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4a864cee-5597-41d1-8f08-3ce64b42785b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:29.541059 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4a864cee-5597-41d1-8f08-3ce64b42785b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:29.547482 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a864cee-5597-41d1-8f08-3ce64b42785b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:29.547934 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a864cee-5597-41d1-8f08-3ce64b42785b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:29.548777 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a864cee-5597-41d1-8f08-3ce64b42785b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:29.549165 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a864cee-5597-41d1-8f08-3ce64b42785b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:29.691804 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4a864cee-5597-41d1-8f08-3ce64b42785b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:29.700098 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4a864cee-5597-41d1-8f08-3ce64b42785b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:29.701588 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4a864cee-5597-41d1-8f08-3ce64b42785b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:29.702793 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4a864cee-5597-41d1-8f08-3ce64b42785b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.165951 Nov 12 02:31:29.703348 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 453/876] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:29 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:30.236696 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7aecc8a2-3f31-4aa9-b2a8-f16a7d25eaae tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:30.237966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7aecc8a2-3f31-4aa9-b2a8-f16a7d25eaae tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:30.244467 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7aecc8a2-3f31-4aa9-b2a8-f16a7d25eaae tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:30.244913 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7aecc8a2-3f31-4aa9-b2a8-f16a7d25eaae tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:30.245684 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7aecc8a2-3f31-4aa9-b2a8-f16a7d25eaae tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:30.246114 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7aecc8a2-3f31-4aa9-b2a8-f16a7d25eaae tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:30.400597 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7aecc8a2-3f31-4aa9-b2a8-f16a7d25eaae tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:30.408707 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7aecc8a2-3f31-4aa9-b2a8-f16a7d25eaae tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1315 microversion: 2.1 time: 0.175526 Nov 12 02:31:30.410027 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 424/877] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:30 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:30.721565 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d6e88eab-1681-4909-b54e-d283687c0c35 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:30.722262 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d6e88eab-1681-4909-b54e-d283687c0c35 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:30.730817 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-8a5a2914-5adc-4e42-b294-9acac4b0d78d req-5999f45e-c05c-46fa-9a98-fe42eda74d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1e3b55-ec7c-4307-98ec-25aab7b162c3", "name": "network-vif-plugged", "status": "completed", "tag": "44b41f6f-a0e0-4053-88d3-7b3c84082626"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:31:30.732428 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:31:30.732428 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:31:30.732864 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d6e88eab-1681-4909-b54e-d283687c0c35 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:30.733814 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d6e88eab-1681-4909-b54e-d283687c0c35 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:30.734657 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d6e88eab-1681-4909-b54e-d283687c0c35 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:30.735187 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d6e88eab-1681-4909-b54e-d283687c0c35 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:30.740596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-8a5a2914-5adc-4e42-b294-9acac4b0d78d req-5999f45e-c05c-46fa-9a98-fe42eda74d20 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:30.741038 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-8a5a2914-5adc-4e42-b294-9acac4b0d78d req-5999f45e-c05c-46fa-9a98-fe42eda74d20 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:30.753757 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-8a5a2914-5adc-4e42-b294-9acac4b0d78d req-5999f45e-c05c-46fa-9a98-fe42eda74d20 service nova] Creating event network-vif-plugged:44b41f6f-a0e0-4053-88d3-7b3c84082626 for instance ce1e3b55-ec7c-4307-98ec-25aab7b162c3 on hv-cinder-80857 Nov 12 02:31:30.759596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-8a5a2914-5adc-4e42-b294-9acac4b0d78d req-5999f45e-c05c-46fa-9a98-fe42eda74d20 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032231 Nov 12 02:31:30.760554 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 425/878] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:31:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:31:30.901081 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d6e88eab-1681-4909-b54e-d283687c0c35 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:30.909661 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d6e88eab-1681-4909-b54e-d283687c0c35 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:30.911368 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d6e88eab-1681-4909-b54e-d283687c0c35 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:30.912548 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d6e88eab-1681-4909-b54e-d283687c0c35 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.195042 Nov 12 02:31:30.913105 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 454/879] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:30 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:31:31.427595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cd881ed2-cc5a-491f-af42-103b73482690 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:31.428194 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cd881ed2-cc5a-491f-af42-103b73482690 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:31.434163 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd881ed2-cc5a-491f-af42-103b73482690 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:31.434606 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd881ed2-cc5a-491f-af42-103b73482690 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:31.435398 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd881ed2-cc5a-491f-af42-103b73482690 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:31.435829 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd881ed2-cc5a-491f-af42-103b73482690 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:31.565450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cd881ed2-cc5a-491f-af42-103b73482690 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:31.572679 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cd881ed2-cc5a-491f-af42-103b73482690 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1315 microversion: 2.1 time: 0.149897 Nov 12 02:31:31.573254 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 426/880] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:31 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:31.931385 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3b265d29-93c4-43ea-876f-78b8ed77197c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:31.931970 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3b265d29-93c4-43ea-876f-78b8ed77197c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:31.938184 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3b265d29-93c4-43ea-876f-78b8ed77197c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:31.938576 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3b265d29-93c4-43ea-876f-78b8ed77197c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:31.939445 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3b265d29-93c4-43ea-876f-78b8ed77197c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:31.939880 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3b265d29-93c4-43ea-876f-78b8ed77197c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:32.071423 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3b265d29-93c4-43ea-876f-78b8ed77197c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:32.079706 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3b265d29-93c4-43ea-876f-78b8ed77197c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:32.081704 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3b265d29-93c4-43ea-876f-78b8ed77197c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:32.082918 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3b265d29-93c4-43ea-876f-78b8ed77197c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.155210 Nov 12 02:31:32.083478 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 455/881] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:31 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:32.591013 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fffb5ca5-4086-4159-87e0-2337e31780a9 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:32.592313 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fffb5ca5-4086-4159-87e0-2337e31780a9 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:32.600438 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fffb5ca5-4086-4159-87e0-2337e31780a9 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:32.600982 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fffb5ca5-4086-4159-87e0-2337e31780a9 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:32.601879 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fffb5ca5-4086-4159-87e0-2337e31780a9 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:32.602525 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fffb5ca5-4086-4159-87e0-2337e31780a9 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:32.756331 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fffb5ca5-4086-4159-87e0-2337e31780a9 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:32.764129 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fffb5ca5-4086-4159-87e0-2337e31780a9 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1464 microversion: 2.1 time: 0.178099 Nov 12 02:31:32.764798 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 427/882] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:32 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1464 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:32.780865 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-f529e0b4-c92b-402b-b14f-285467c4908c req-b3dd031f-2119-4dc0-b526-60d926787ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d16c68-a04c-4a32-a599-e202e6c64152", "name": "network-vif-plugged", "status": "completed", "tag": "6159a4de-08df-4c5b-afb6-bc1f4e2f213f"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:31:32.782413 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:31:32.782413 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:31:32.789360 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-f529e0b4-c92b-402b-b14f-285467c4908c req-b3dd031f-2119-4dc0-b526-60d926787ca2 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:32.789804 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-f529e0b4-c92b-402b-b14f-285467c4908c req-b3dd031f-2119-4dc0-b526-60d926787ca2 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:32.802370 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-f529e0b4-c92b-402b-b14f-285467c4908c req-b3dd031f-2119-4dc0-b526-60d926787ca2 service nova] Creating event network-vif-plugged:6159a4de-08df-4c5b-afb6-bc1f4e2f213f for instance 26d16c68-a04c-4a32-a599-e202e6c64152 on hv-cinder-80857 Nov 12 02:31:32.803840 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-839624df-0fad-4252-8ab5-df1f6316f254 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:32.804459 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-839624df-0fad-4252-8ab5-df1f6316f254 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:32.808172 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-f529e0b4-c92b-402b-b14f-285467c4908c req-b3dd031f-2119-4dc0-b526-60d926787ca2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030901 Nov 12 02:31:32.808769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 456/883] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:31:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:31:32.811225 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-839624df-0fad-4252-8ab5-df1f6316f254 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:32.811980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-839624df-0fad-4252-8ab5-df1f6316f254 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:32.812995 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-839624df-0fad-4252-8ab5-df1f6316f254 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:32.813536 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-839624df-0fad-4252-8ab5-df1f6316f254 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:32.839224 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-839624df-0fad-4252-8ab5-df1f6316f254 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:31:32.918398 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-839624df-0fad-4252-8ab5-df1f6316f254 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 204 len: 0 microversion: 2.1 time: 0.118516 Nov 12 02:31:32.919755 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 428/884] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:31:32 2021] DELETE /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:31:32.929619 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2df284df-2fb0-4834-8cb1-af640aec3a7a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:32.930321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2df284df-2fb0-4834-8cb1-af640aec3a7a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:32.937168 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2df284df-2fb0-4834-8cb1-af640aec3a7a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:32.937799 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2df284df-2fb0-4834-8cb1-af640aec3a7a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:32.938413 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2df284df-2fb0-4834-8cb1-af640aec3a7a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:32.938899 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2df284df-2fb0-4834-8cb1-af640aec3a7a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:33.101793 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f0c2b1d6-e94a-40c1-9ddc-e986b29ecccb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:33.102606 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f0c2b1d6-e94a-40c1-9ddc-e986b29ecccb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:33.108734 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f0c2b1d6-e94a-40c1-9ddc-e986b29ecccb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:33.109262 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f0c2b1d6-e94a-40c1-9ddc-e986b29ecccb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:33.110286 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f0c2b1d6-e94a-40c1-9ddc-e986b29ecccb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:33.110850 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f0c2b1d6-e94a-40c1-9ddc-e986b29ecccb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:33.116758 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-2df284df-2fb0-4834-8cb1-af640aec3a7a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:33.124828 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2df284df-2fb0-4834-8cb1-af640aec3a7a tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1470 microversion: 2.1 time: 0.200391 Nov 12 02:31:33.125410 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 457/885] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:32 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:33.333541 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f0c2b1d6-e94a-40c1-9ddc-e986b29ecccb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:33.345512 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f0c2b1d6-e94a-40c1-9ddc-e986b29ecccb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:33.348784 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f0c2b1d6-e94a-40c1-9ddc-e986b29ecccb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:33.350707 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f0c2b1d6-e94a-40c1-9ddc-e986b29ecccb tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.252941 Nov 12 02:31:33.367253 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 429/886] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:33 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:34.147398 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c005e5c0-60eb-4602-b312-15424253b784 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:34.148070 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c005e5c0-60eb-4602-b312-15424253b784 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:34.158723 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c005e5c0-60eb-4602-b312-15424253b784 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:34.159194 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c005e5c0-60eb-4602-b312-15424253b784 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:34.160004 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c005e5c0-60eb-4602-b312-15424253b784 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:34.160440 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c005e5c0-60eb-4602-b312-15424253b784 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:34.342522 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c005e5c0-60eb-4602-b312-15424253b784 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:34.352901 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c005e5c0-60eb-4602-b312-15424253b784 tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1470 microversion: 2.1 time: 0.210325 Nov 12 02:31:34.353483 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 458/887] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:34 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:34.377619 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2f9fa611-546f-49ec-90dc-fafaf1b66fab tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:34.379093 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2f9fa611-546f-49ec-90dc-fafaf1b66fab tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:34.386168 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f9fa611-546f-49ec-90dc-fafaf1b66fab tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:34.386804 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f9fa611-546f-49ec-90dc-fafaf1b66fab tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:34.387693 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f9fa611-546f-49ec-90dc-fafaf1b66fab tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:34.388161 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f9fa611-546f-49ec-90dc-fafaf1b66fab tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:34.568745 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2f9fa611-546f-49ec-90dc-fafaf1b66fab tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:34.577349 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2f9fa611-546f-49ec-90dc-fafaf1b66fab tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:34.578915 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2f9fa611-546f-49ec-90dc-fafaf1b66fab tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:34.580151 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2f9fa611-546f-49ec-90dc-fafaf1b66fab tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.207402 Nov 12 02:31:34.580756 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 430/888] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:34 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:35.375138 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-06660fae-8df0-4416-8308-677c84fd9d3e tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:35.378804 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-06660fae-8df0-4416-8308-677c84fd9d3e tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:35.390444 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-06660fae-8df0-4416-8308-677c84fd9d3e tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:35.395262 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-06660fae-8df0-4416-8308-677c84fd9d3e tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:35.396327 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-06660fae-8df0-4416-8308-677c84fd9d3e tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:35.398532 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-06660fae-8df0-4416-8308-677c84fd9d3e tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:35.604296 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-64f0d16f-bc0f-4e48-a8fe-93a02fe5c024 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:35.606281 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-64f0d16f-bc0f-4e48-a8fe-93a02fe5c024 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:35.618541 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-64f0d16f-bc0f-4e48-a8fe-93a02fe5c024 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:35.619875 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-64f0d16f-bc0f-4e48-a8fe-93a02fe5c024 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:35.621558 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-64f0d16f-bc0f-4e48-a8fe-93a02fe5c024 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:35.622609 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-64f0d16f-bc0f-4e48-a8fe-93a02fe5c024 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:35.636883 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-06660fae-8df0-4416-8308-677c84fd9d3e tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:35.651094 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-06660fae-8df0-4416-8308-677c84fd9d3e tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1470 microversion: 2.1 time: 0.281600 Nov 12 02:31:35.652061 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 459/889] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:35 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:35.895464 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-64f0d16f-bc0f-4e48-a8fe-93a02fe5c024 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:35.909879 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-64f0d16f-bc0f-4e48-a8fe-93a02fe5c024 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:35.919248 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-64f0d16f-bc0f-4e48-a8fe-93a02fe5c024 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:35.920889 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-64f0d16f-bc0f-4e48-a8fe-93a02fe5c024 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1807 microversion: 2.20 time: 0.324144 Nov 12 02:31:35.922918 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 431/890] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:35 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1807 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:36.262917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-f7908820-ae69-4ea5-9595-730482bda80a req-5b8cbc69-a528-4a08-bf03-0eab2be3555a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1e3b55-ec7c-4307-98ec-25aab7b162c3", "name": "network-vif-deleted", "tag": "44b41f6f-a0e0-4053-88d3-7b3c84082626"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:31:36.265222 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:31:36.265222 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:31:36.277915 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-f7908820-ae69-4ea5-9595-730482bda80a req-5b8cbc69-a528-4a08-bf03-0eab2be3555a service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:36.278621 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-f7908820-ae69-4ea5-9595-730482bda80a req-5b8cbc69-a528-4a08-bf03-0eab2be3555a service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:36.295557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-f7908820-ae69-4ea5-9595-730482bda80a req-5b8cbc69-a528-4a08-bf03-0eab2be3555a service nova] Creating event network-vif-deleted:44b41f6f-a0e0-4053-88d3-7b3c84082626 for instance ce1e3b55-ec7c-4307-98ec-25aab7b162c3 on hv-cinder-80857 Nov 12 02:31:36.304054 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-f7908820-ae69-4ea5-9595-730482bda80a req-5b8cbc69-a528-4a08-bf03-0eab2be3555a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044238 Nov 12 02:31:36.310178 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 460/891] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:31:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:31:36.678493 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6ce04a68-a351-44cb-afe3-c33fd3f5dc2f tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:36.679372 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6ce04a68-a351-44cb-afe3-c33fd3f5dc2f tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:36.686857 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6ce04a68-a351-44cb-afe3-c33fd3f5dc2f tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:36.687499 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6ce04a68-a351-44cb-afe3-c33fd3f5dc2f tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:36.688185 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6ce04a68-a351-44cb-afe3-c33fd3f5dc2f tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:36.688671 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6ce04a68-a351-44cb-afe3-c33fd3f5dc2f tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:36.722967 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6ce04a68-a351-44cb-afe3-c33fd3f5dc2f tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:36.723815 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6ce04a68-a351-44cb-afe3-c33fd3f5dc2f tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:36.724518 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-6ce04a68-a351-44cb-afe3-c33fd3f5dc2f tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lazy-loading 'fault' on Instance uuid ce1e3b55-ec7c-4307-98ec-25aab7b162c3 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:31:36.772234 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6ce04a68-a351-44cb-afe3-c33fd3f5dc2f tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f2fab4debff4bd7a577cff7a73e6d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a876e3d7f3a34cf39a0e1b64acd65553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:36.784993 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6ce04a68-a351-44cb-afe3-c33fd3f5dc2f tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 200 len: 1305 microversion: 2.1 time: 0.109658 Nov 12 02:31:36.785907 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 432/892] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:36 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:31:36.941091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5173d3b1-ff01-479f-b2c3-cfc210ebb0d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:36.941731 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5173d3b1-ff01-479f-b2c3-cfc210ebb0d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:36.948356 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5173d3b1-ff01-479f-b2c3-cfc210ebb0d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:36.948843 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5173d3b1-ff01-479f-b2c3-cfc210ebb0d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:36.949784 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5173d3b1-ff01-479f-b2c3-cfc210ebb0d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:36.950263 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5173d3b1-ff01-479f-b2c3-cfc210ebb0d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:37.122011 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5173d3b1-ff01-479f-b2c3-cfc210ebb0d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:37.131580 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5173d3b1-ff01-479f-b2c3-cfc210ebb0d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:37.133106 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5173d3b1-ff01-479f-b2c3-cfc210ebb0d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:37.134497 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5173d3b1-ff01-479f-b2c3-cfc210ebb0d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1794 microversion: 2.20 time: 0.198204 Nov 12 02:31:37.135228 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 461/893] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:31:36 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1794 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:31:37.806769 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2e422cc2-688e-437b-87e0-d60f159190af tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:37.807543 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2e422cc2-688e-437b-87e0-d60f159190af tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] [instance: ce1e3b55-ec7c-4307-98ec-25aab7b162c3] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:37.817816 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e422cc2-688e-437b-87e0-d60f159190af tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:37.818520 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e422cc2-688e-437b-87e0-d60f159190af tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:37.820140 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e422cc2-688e-437b-87e0-d60f159190af tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:37.820826 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2e422cc2-688e-437b-87e0-d60f159190af tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:37.842487 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-2e422cc2-688e-437b-87e0-d60f159190af tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] HTTP exception thrown: Instance ce1e3b55-ec7c-4307-98ec-25aab7b162c3 could not be found. Nov 12 02:31:37.843263 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2e422cc2-688e-437b-87e0-d60f159190af tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] Returning 404 to user: Instance ce1e3b55-ec7c-4307-98ec-25aab7b162c3 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:31:37.844610 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2e422cc2-688e-437b-87e0-d60f159190af tempest-VolumesNegativeTest-1966612178 tempest-VolumesNegativeTest-1966612178-project] 10.222.0.70 "GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3" status: 404 len: 111 microversion: 2.1 time: 0.043591 Nov 12 02:31:37.845552 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 433/894] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:37 2021] GET /compute/v2.1/servers/ce1e3b55-ec7c-4307-98ec-25aab7b162c3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:31:45.524562 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c95b3371-53ff-4a55-a0c1-632bc3cd706e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:45.525117 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c95b3371-53ff-4a55-a0c1-632bc3cd706e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:45.531318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c95b3371-53ff-4a55-a0c1-632bc3cd706e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:45.531765 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c95b3371-53ff-4a55-a0c1-632bc3cd706e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:45.532577 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c95b3371-53ff-4a55-a0c1-632bc3cd706e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:45.533055 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c95b3371-53ff-4a55-a0c1-632bc3cd706e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:45.567039 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c95b3371-53ff-4a55-a0c1-632bc3cd706e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Going to try to terminate instance {{(pid=116099) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:31:45.669551 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c95b3371-53ff-4a55-a0c1-632bc3cd706e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 204 len: 0 microversion: 2.1 time: 0.148172 Nov 12 02:31:45.670611 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 462/895] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:31:45 2021] DELETE /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:31:45.682733 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fb89acb2-77d7-415f-b75f-528458514197 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:45.683519 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fb89acb2-77d7-415f-b75f-528458514197 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:45.688087 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-974697339", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "networks": [{"uuid": "0f0e86fc-5462-49b5-aded-e18529b430ae"}]}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:31:45.692577 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fb89acb2-77d7-415f-b75f-528458514197 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:45.693120 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fb89acb2-77d7-415f-b75f-528458514197 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:45.693980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fb89acb2-77d7-415f-b75f-528458514197 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:45.694831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fb89acb2-77d7-415f-b75f-528458514197 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:45.747559 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.network.neutron [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] validate_networks() for [('0f0e86fc-5462-49b5-aded-e18529b430ae', None, None, None, None, None)] {{(pid=116099) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:31:45.950157 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fb89acb2-77d7-415f-b75f-528458514197 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:45.964343 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fb89acb2-77d7-415f-b75f-528458514197 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1576 microversion: 2.1 time: 0.287466 Nov 12 02:31:45.964966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 434/896] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:45 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1576 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:46.245550 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Flavor limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:31:46.245967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Image limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:31:46.246435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Flavor pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:31:46.246870 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Image pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:31:46.247271 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:31:46.257322 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:46.257769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:46.258574 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:46.259056 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:46.276598 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Getting quotas for project a03794071c7f41db801753ddab2f9971. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:31:46.280595 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Getting quotas for user 58af07ec5a0c408faf8ccd6c7e9c0a88 and project a03794071c7f41db801753ddab2f9971. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:31:46.293376 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Going to run 1 instances... {{(pid=116099) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:31:46.295864 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:31:46.348626 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-45fd8606-6b54-4f40-8a5a-07b10c20776b tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664174 Nov 12 02:31:46.353993 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 463/897] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:31:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:31:46.362726 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c11a623a-95df-4095-a961-1c28ebf6596e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:46.366597 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c11a623a-95df-4095-a961-1c28ebf6596e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:46.437948 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c11a623a-95df-4095-a961-1c28ebf6596e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:46.446293 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c11a623a-95df-4095-a961-1c28ebf6596e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1218 microversion: 2.1 time: 0.090026 Nov 12 02:31:46.446958 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 435/898] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:46 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:46.999300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2401238e-3df1-4835-affb-b0ddd3b7d543 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:47.007442 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2401238e-3df1-4835-affb-b0ddd3b7d543 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:47.011036 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2401238e-3df1-4835-affb-b0ddd3b7d543 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:47.011761 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2401238e-3df1-4835-affb-b0ddd3b7d543 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:47.012734 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2401238e-3df1-4835-affb-b0ddd3b7d543 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:47.013176 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2401238e-3df1-4835-affb-b0ddd3b7d543 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:47.165806 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-2401238e-3df1-4835-affb-b0ddd3b7d543 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:47.175228 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2401238e-3df1-4835-affb-b0ddd3b7d543 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1576 microversion: 2.1 time: 0.182983 Nov 12 02:31:47.185881 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 464/899] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:46 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:47.466008 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a4bafd4d-48e4-4f15-a9f4-497e23d246e1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:47.466539 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a4bafd4d-48e4-4f15-a9f4-497e23d246e1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:47.473461 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4bafd4d-48e4-4f15-a9f4-497e23d246e1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:47.473905 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4bafd4d-48e4-4f15-a9f4-497e23d246e1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:47.474737 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4bafd4d-48e4-4f15-a9f4-497e23d246e1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:47.475171 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4bafd4d-48e4-4f15-a9f4-497e23d246e1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:47.537241 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a4bafd4d-48e4-4f15-a9f4-497e23d246e1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:47.545155 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a4bafd4d-48e4-4f15-a9f4-497e23d246e1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1270 microversion: 2.1 time: 0.082960 Nov 12 02:31:47.545743 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 436/900] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:47 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:31:48.193633 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b060ab35-3117-46f5-9999-f7d45d8094b8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:48.194425 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b060ab35-3117-46f5-9999-f7d45d8094b8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:48.201778 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b060ab35-3117-46f5-9999-f7d45d8094b8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:48.202371 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b060ab35-3117-46f5-9999-f7d45d8094b8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:48.203360 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b060ab35-3117-46f5-9999-f7d45d8094b8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:48.203849 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b060ab35-3117-46f5-9999-f7d45d8094b8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:48.426573 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b060ab35-3117-46f5-9999-f7d45d8094b8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:48.434498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b060ab35-3117-46f5-9999-f7d45d8094b8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1576 microversion: 2.1 time: 0.245555 Nov 12 02:31:48.435109 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 465/901] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:48 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:48.562772 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7957d019-f11a-4d2f-9865-a05052cd5e40 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:48.563967 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7957d019-f11a-4d2f-9865-a05052cd5e40 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:48.571043 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7957d019-f11a-4d2f-9865-a05052cd5e40 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:48.571795 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7957d019-f11a-4d2f-9865-a05052cd5e40 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:48.572606 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7957d019-f11a-4d2f-9865-a05052cd5e40 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:48.573047 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7957d019-f11a-4d2f-9865-a05052cd5e40 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:49.071149 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7957d019-f11a-4d2f-9865-a05052cd5e40 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:49.082075 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7957d019-f11a-4d2f-9865-a05052cd5e40 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1318 microversion: 2.1 time: 0.522574 Nov 12 02:31:49.083882 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 437/902] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:48 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:49.456332 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-802de2df-27f1-41f8-b3a5-dd9e0dca662a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:49.457037 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-802de2df-27f1-41f8-b3a5-dd9e0dca662a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:49.465299 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-802de2df-27f1-41f8-b3a5-dd9e0dca662a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:49.465742 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-802de2df-27f1-41f8-b3a5-dd9e0dca662a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:49.466520 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-802de2df-27f1-41f8-b3a5-dd9e0dca662a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:49.467138 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-802de2df-27f1-41f8-b3a5-dd9e0dca662a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:49.504671 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-f9f19aec-0e9d-4bba-9fb5-d2041c8b0d31 req-54121046-9bf2-4619-b72b-8175ca5999ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b806f575-4671-4182-825f-c3c0b1a3122d", "tag": "0505075a-de86-4382-954f-d4b52a1d0777"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:31:49.509334 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:31:49.509334 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:31:49.523890 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-f9f19aec-0e9d-4bba-9fb5-d2041c8b0d31 req-54121046-9bf2-4619-b72b-8175ca5999ee service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:49.528145 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-f9f19aec-0e9d-4bba-9fb5-d2041c8b0d31 req-54121046-9bf2-4619-b72b-8175ca5999ee service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:49.555655 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-f9f19aec-0e9d-4bba-9fb5-d2041c8b0d31 req-54121046-9bf2-4619-b72b-8175ca5999ee service nova] Creating event network-changed:0505075a-de86-4382-954f-d4b52a1d0777 for instance b806f575-4671-4182-825f-c3c0b1a3122d on hv-cinder-80857 Nov 12 02:31:49.563895 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-f9f19aec-0e9d-4bba-9fb5-d2041c8b0d31 req-54121046-9bf2-4619-b72b-8175ca5999ee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229314 Nov 12 02:31:49.565479 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 466/903] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:31:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:31:49.594142 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-802de2df-27f1-41f8-b3a5-dd9e0dca662a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:49.605023 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-802de2df-27f1-41f8-b3a5-dd9e0dca662a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1509 microversion: 2.1 time: 0.151267 Nov 12 02:31:49.618131 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 438/904] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:49 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:31:49.656547 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-f805fd8c-9164-4ba7-a73e-c641193b9e07 req-ad871906-68da-438e-8969-ce448226c412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f436b1-6651-4ba7-88f7-fb2b262f75a5", "name": "network-vif-deleted", "tag": "1d8b5f9f-4b28-410e-8111-4c6483f94044"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:31:49.658294 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:31:49.658294 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:31:49.666411 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-f805fd8c-9164-4ba7-a73e-c641193b9e07 req-ad871906-68da-438e-8969-ce448226c412 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:49.678180 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-f805fd8c-9164-4ba7-a73e-c641193b9e07 req-ad871906-68da-438e-8969-ce448226c412 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:49.694822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-f805fd8c-9164-4ba7-a73e-c641193b9e07 req-ad871906-68da-438e-8969-ce448226c412 service nova] Creating event network-vif-deleted:1d8b5f9f-4b28-410e-8111-4c6483f94044 for instance a5f436b1-6651-4ba7-88f7-fb2b262f75a5 on hv-cinder-80857 Nov 12 02:31:49.702520 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-f805fd8c-9164-4ba7-a73e-c641193b9e07 req-ad871906-68da-438e-8969-ce448226c412 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135225 Nov 12 02:31:49.704507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 467/905] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:31:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:31:50.100618 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a4ac0615-621f-49a3-9fe2-9533e107dd17 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:50.102247 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a4ac0615-621f-49a3-9fe2-9533e107dd17 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:50.121889 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4ac0615-621f-49a3-9fe2-9533e107dd17 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:50.123717 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4ac0615-621f-49a3-9fe2-9533e107dd17 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:50.124805 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4ac0615-621f-49a3-9fe2-9533e107dd17 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:50.125247 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4ac0615-621f-49a3-9fe2-9533e107dd17 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:50.329503 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a4ac0615-621f-49a3-9fe2-9533e107dd17 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:50.356378 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a4ac0615-621f-49a3-9fe2-9533e107dd17 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1318 microversion: 2.1 time: 0.260171 Nov 12 02:31:50.360666 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 439/906] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:50 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:50.624378 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b136cb14-51c1-430c-98f0-4e4a7a4b9ad1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:50.625075 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b136cb14-51c1-430c-98f0-4e4a7a4b9ad1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:50.632374 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b136cb14-51c1-430c-98f0-4e4a7a4b9ad1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:50.632836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b136cb14-51c1-430c-98f0-4e4a7a4b9ad1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:50.633803 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b136cb14-51c1-430c-98f0-4e4a7a4b9ad1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:50.634534 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b136cb14-51c1-430c-98f0-4e4a7a4b9ad1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:50.668578 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b136cb14-51c1-430c-98f0-4e4a7a4b9ad1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:50.669028 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b136cb14-51c1-430c-98f0-4e4a7a4b9ad1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:50.669483 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-b136cb14-51c1-430c-98f0-4e4a7a4b9ad1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lazy-loading 'fault' on Instance uuid a5f436b1-6651-4ba7-88f7-fb2b262f75a5 {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:31:50.711936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b136cb14-51c1-430c-98f0-4e4a7a4b9ad1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:50.719709 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b136cb14-51c1-430c-98f0-4e4a7a4b9ad1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 200 len: 1230 microversion: 2.1 time: 0.099388 Nov 12 02:31:50.720523 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 468/907] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:50 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:51.377062 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-87e5d9f5-bd4a-4d2c-a8a0-a247a29164b9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:51.377724 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-87e5d9f5-bd4a-4d2c-a8a0-a247a29164b9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:51.384161 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-87e5d9f5-bd4a-4d2c-a8a0-a247a29164b9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:51.384606 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-87e5d9f5-bd4a-4d2c-a8a0-a247a29164b9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:51.385374 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-87e5d9f5-bd4a-4d2c-a8a0-a247a29164b9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:51.385800 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-87e5d9f5-bd4a-4d2c-a8a0-a247a29164b9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:51.516287 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-87e5d9f5-bd4a-4d2c-a8a0-a247a29164b9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:51.524141 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-87e5d9f5-bd4a-4d2c-a8a0-a247a29164b9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1318 microversion: 2.1 time: 0.150811 Nov 12 02:31:51.524718 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 440/908] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:51 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:51.737848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-65fb8814-a975-4701-b31f-72ac35c8cab3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:51.738454 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-65fb8814-a975-4701-b31f-72ac35c8cab3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:51.745318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-65fb8814-a975-4701-b31f-72ac35c8cab3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:51.745784 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-65fb8814-a975-4701-b31f-72ac35c8cab3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:51.746558 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-65fb8814-a975-4701-b31f-72ac35c8cab3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:51.747036 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-65fb8814-a975-4701-b31f-72ac35c8cab3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:51.762082 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-65fb8814-a975-4701-b31f-72ac35c8cab3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] HTTP exception thrown: Instance a5f436b1-6651-4ba7-88f7-fb2b262f75a5 could not be found. Nov 12 02:31:51.762763 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-65fb8814-a975-4701-b31f-72ac35c8cab3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Returning 404 to user: Instance a5f436b1-6651-4ba7-88f7-fb2b262f75a5 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:31:51.763557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-65fb8814-a975-4701-b31f-72ac35c8cab3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 404 len: 111 microversion: 2.1 time: 0.029751 Nov 12 02:31:51.764108 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 469/909] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:51 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:31:51.863771 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-385834007", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1761431138", "security_groups": [{"name": "tempest-secgroup-smoke-677549840"}], "block_device_mapping_v2": [{"uuid": "8f15182e-2c61-4ecc-8a5f-f111473e5938", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "987f135b-2ece-4383-9fb9-ce7b7e8f8bd1"}]}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:31:51.974322 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] validate_networks() for [('987f135b-2ece-4383-9fb9-ce7b7e8f8bd1', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:31:52.397521 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:31:52.398496 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:31:52.399021 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:31:52.399528 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:31:52.400036 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:31:52.410177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:52.410616 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:52.411455 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:52.411885 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:52.428216 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Getting quotas for project cdddbe78d48c4a9995c9d3e6c06bec3d. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:31:52.432056 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Getting quotas for user e5cae9ebcf844041b45c03bfd1fddcf6 and project cdddbe78d48c4a9995c9d3e6c06bec3d. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:31:52.487377 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:31:52.489502 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f15182e-2c61-4ecc-8a5f-f111473e5938',volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:31:52.540604 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d9fb1b6b-c02d-4065-98e7-c79c270385b1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:52.541303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d9fb1b6b-c02d-4065-98e7-c79c270385b1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:52.546943 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d9fb1b6b-c02d-4065-98e7-c79c270385b1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:52.547395 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d9fb1b6b-c02d-4065-98e7-c79c270385b1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:52.548344 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d9fb1b6b-c02d-4065-98e7-c79c270385b1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:52.548779 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d9fb1b6b-c02d-4065-98e7-c79c270385b1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:52.625188 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9c9fa113-b839-493c-9850-e5dd78daffeb tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.765560 Nov 12 02:31:52.625852 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 441/910] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:31:51 2021] POST /compute/v2.1/servers => generated 405 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:31:52.636629 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c35056f8-b898-411c-93f2-b07519eae428 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:52.637253 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c35056f8-b898-411c-93f2-b07519eae428 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:52.718889 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c35056f8-b898-411c-93f2-b07519eae428 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:52.724354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d9fb1b6b-c02d-4065-98e7-c79c270385b1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:52.733998 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d9fb1b6b-c02d-4065-98e7-c79c270385b1 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1318 microversion: 2.1 time: 0.197181 Nov 12 02:31:52.735465 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 470/911] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:52 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:31:52.750419 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c35056f8-b898-411c-93f2-b07519eae428 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1094 microversion: 2.1 time: 0.117407 Nov 12 02:31:52.751164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 442/912] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:52 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1094 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:31:53.752934 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7cc72561-0e16-4918-9378-f308e8c7efb9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:53.753764 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7cc72561-0e16-4918-9378-f308e8c7efb9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:53.761046 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7cc72561-0e16-4918-9378-f308e8c7efb9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:53.761555 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7cc72561-0e16-4918-9378-f308e8c7efb9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:53.762470 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7cc72561-0e16-4918-9378-f308e8c7efb9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:53.763300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7cc72561-0e16-4918-9378-f308e8c7efb9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:53.768376 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-553fc330-0948-4065-95a5-7420827c5bf7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:53.770520 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-553fc330-0948-4065-95a5-7420827c5bf7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:53.779288 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-553fc330-0948-4065-95a5-7420827c5bf7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:53.780291 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-553fc330-0948-4065-95a5-7420827c5bf7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:53.782894 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-553fc330-0948-4065-95a5-7420827c5bf7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:53.783640 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-553fc330-0948-4065-95a5-7420827c5bf7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:53.865811 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-553fc330-0948-4065-95a5-7420827c5bf7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:53.881986 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-553fc330-0948-4065-95a5-7420827c5bf7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1210 microversion: 2.1 time: 0.117331 Nov 12 02:31:53.882654 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 443/913] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:53 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1210 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:53.942117 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7cc72561-0e16-4918-9378-f308e8c7efb9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:53.949470 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7cc72561-0e16-4918-9378-f308e8c7efb9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1318 microversion: 2.1 time: 0.201364 Nov 12 02:31:53.950046 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 471/914] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:53 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:54.899166 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2817a956-e1d1-4f34-8629-f1ce59315e68 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:54.899785 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2817a956-e1d1-4f34-8629-f1ce59315e68 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:54.906335 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2817a956-e1d1-4f34-8629-f1ce59315e68 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:54.906824 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2817a956-e1d1-4f34-8629-f1ce59315e68 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:54.907626 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2817a956-e1d1-4f34-8629-f1ce59315e68 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:54.908079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2817a956-e1d1-4f34-8629-f1ce59315e68 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:54.966986 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7d9c6702-8185-422f-8150-3a58dcea820f tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:54.973906 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7d9c6702-8185-422f-8150-3a58dcea820f tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:54.981855 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7d9c6702-8185-422f-8150-3a58dcea820f tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:54.985079 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7d9c6702-8185-422f-8150-3a58dcea820f tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:54.986941 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7d9c6702-8185-422f-8150-3a58dcea820f tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:54.990617 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7d9c6702-8185-422f-8150-3a58dcea820f tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:55.094993 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2817a956-e1d1-4f34-8629-f1ce59315e68 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:55.111765 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2817a956-e1d1-4f34-8629-f1ce59315e68 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1265 microversion: 2.1 time: 0.214231 Nov 12 02:31:55.113441 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 444/915] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:54 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:55.192661 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7d9c6702-8185-422f-8150-3a58dcea820f tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:55.201059 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-22d93c8f-ce12-47c5-b4d9-721d52b7ca29 req-83bbe3c6-e04a-4014-86c7-9548a7a9c840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b66789-7ae5-4589-bd84-3539cf00e97f", "tag": "9ea72f7b-3a91-4bd5-9bee-cf36f50653a8"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:31:55.203084 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:31:55.203084 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:31:55.219397 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7d9c6702-8185-422f-8150-3a58dcea820f tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1318 microversion: 2.1 time: 0.256125 Nov 12 02:31:55.219986 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 472/916] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:54 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:55.224023 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-22d93c8f-ce12-47c5-b4d9-721d52b7ca29 req-83bbe3c6-e04a-4014-86c7-9548a7a9c840 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:55.224686 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-22d93c8f-ce12-47c5-b4d9-721d52b7ca29 req-83bbe3c6-e04a-4014-86c7-9548a7a9c840 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:55.257883 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-22d93c8f-ce12-47c5-b4d9-721d52b7ca29 req-83bbe3c6-e04a-4014-86c7-9548a7a9c840 service nova] Creating event network-changed:9ea72f7b-3a91-4bd5-9bee-cf36f50653a8 for instance 41b66789-7ae5-4589-bd84-3539cf00e97f on hv-cinder-80857 Nov 12 02:31:55.263790 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-22d93c8f-ce12-47c5-b4d9-721d52b7ca29 req-83bbe3c6-e04a-4014-86c7-9548a7a9c840 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067253 Nov 12 02:31:55.264955 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 445/917] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:31:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:31:56.137895 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-abffb522-46f3-41f9-89ae-c75d1f43486e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:56.138508 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-abffb522-46f3-41f9-89ae-c75d1f43486e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:56.146163 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-abffb522-46f3-41f9-89ae-c75d1f43486e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:56.146960 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-abffb522-46f3-41f9-89ae-c75d1f43486e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:56.148066 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-abffb522-46f3-41f9-89ae-c75d1f43486e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:56.148588 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-abffb522-46f3-41f9-89ae-c75d1f43486e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:56.237943 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8043ea8b-0515-4b1d-b17e-0d6b3566c6e7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:56.239945 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8043ea8b-0515-4b1d-b17e-0d6b3566c6e7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:56.247407 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8043ea8b-0515-4b1d-b17e-0d6b3566c6e7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:56.248185 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8043ea8b-0515-4b1d-b17e-0d6b3566c6e7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:56.249087 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8043ea8b-0515-4b1d-b17e-0d6b3566c6e7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:56.249610 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8043ea8b-0515-4b1d-b17e-0d6b3566c6e7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:56.349149 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-abffb522-46f3-41f9-89ae-c75d1f43486e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:56.356606 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-abffb522-46f3-41f9-89ae-c75d1f43486e tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1265 microversion: 2.1 time: 0.222725 Nov 12 02:31:56.357176 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 473/918] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:56 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:56.419935 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8043ea8b-0515-4b1d-b17e-0d6b3566c6e7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:56.427864 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8043ea8b-0515-4b1d-b17e-0d6b3566c6e7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1318 microversion: 2.1 time: 0.194709 Nov 12 02:31:56.428443 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 446/919] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:56 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:56.750361 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-389d806c-c984-4566-ae81-43e0ded11a03 req-ef100eee-04f4-438e-bef1-36ff3631d62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b806f575-4671-4182-825f-c3c0b1a3122d", "name": "network-vif-plugged", "status": "completed", "tag": "0505075a-de86-4382-954f-d4b52a1d0777"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:31:56.752603 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:31:56.752603 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:31:56.760189 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-389d806c-c984-4566-ae81-43e0ded11a03 req-ef100eee-04f4-438e-bef1-36ff3631d62b service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:56.761326 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-389d806c-c984-4566-ae81-43e0ded11a03 req-ef100eee-04f4-438e-bef1-36ff3631d62b service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:56.773585 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-389d806c-c984-4566-ae81-43e0ded11a03 req-ef100eee-04f4-438e-bef1-36ff3631d62b service nova] Creating event network-vif-plugged:0505075a-de86-4382-954f-d4b52a1d0777 for instance b806f575-4671-4182-825f-c3c0b1a3122d on hv-cinder-80857 Nov 12 02:31:56.778473 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-389d806c-c984-4566-ae81-43e0ded11a03 req-ef100eee-04f4-438e-bef1-36ff3631d62b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031781 Nov 12 02:31:56.779326 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 474/920] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:31:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:31:57.373795 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0922e9d3-cdb8-44f0-9b68-794a4197f1a9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:57.374405 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0922e9d3-cdb8-44f0-9b68-794a4197f1a9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:57.381337 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0922e9d3-cdb8-44f0-9b68-794a4197f1a9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:57.381788 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0922e9d3-cdb8-44f0-9b68-794a4197f1a9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:57.382574 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0922e9d3-cdb8-44f0-9b68-794a4197f1a9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:57.383046 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0922e9d3-cdb8-44f0-9b68-794a4197f1a9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:57.445885 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-43338a35-05cf-4fbe-b780-8886aaaac588 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:57.446802 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-43338a35-05cf-4fbe-b780-8886aaaac588 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:57.453500 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-43338a35-05cf-4fbe-b780-8886aaaac588 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:57.454038 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-43338a35-05cf-4fbe-b780-8886aaaac588 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:57.454994 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-43338a35-05cf-4fbe-b780-8886aaaac588 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:57.455678 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-43338a35-05cf-4fbe-b780-8886aaaac588 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:57.549594 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0922e9d3-cdb8-44f0-9b68-794a4197f1a9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:57.557067 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0922e9d3-cdb8-44f0-9b68-794a4197f1a9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1265 microversion: 2.1 time: 0.186891 Nov 12 02:31:57.557662 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 447/921] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:57 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:57.648005 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-43338a35-05cf-4fbe-b780-8886aaaac588 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:57.655202 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-43338a35-05cf-4fbe-b780-8886aaaac588 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1318 microversion: 2.1 time: 0.213379 Nov 12 02:31:57.655769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 475/922] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:57 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:31:58.574544 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4d0254cb-ce5c-4767-a66f-ce7ce833b1ed tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:58.575220 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4d0254cb-ce5c-4767-a66f-ce7ce833b1ed tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:58.582043 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d0254cb-ce5c-4767-a66f-ce7ce833b1ed tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:58.582489 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d0254cb-ce5c-4767-a66f-ce7ce833b1ed tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:58.583293 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d0254cb-ce5c-4767-a66f-ce7ce833b1ed tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:58.583728 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4d0254cb-ce5c-4767-a66f-ce7ce833b1ed tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:58.671458 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4e928eac-2fee-4606-b93d-dad8496b5fd7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:58.672081 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4e928eac-2fee-4606-b93d-dad8496b5fd7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:58.678478 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e928eac-2fee-4606-b93d-dad8496b5fd7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:58.678954 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e928eac-2fee-4606-b93d-dad8496b5fd7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:58.679768 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e928eac-2fee-4606-b93d-dad8496b5fd7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:58.680216 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e928eac-2fee-4606-b93d-dad8496b5fd7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:58.733906 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4d0254cb-ce5c-4767-a66f-ce7ce833b1ed tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:58.741585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4d0254cb-ce5c-4767-a66f-ce7ce833b1ed tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1265 microversion: 2.1 time: 0.170707 Nov 12 02:31:58.742275 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 448/923] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:58 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:31:58.820429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4e928eac-2fee-4606-b93d-dad8496b5fd7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:58.827743 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4e928eac-2fee-4606-b93d-dad8496b5fd7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1318 microversion: 2.1 time: 0.159746 Nov 12 02:31:58.828498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 476/924] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:58 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:31:59.758902 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9eb71975-3d4d-4493-86a6-4ab47fd0c19a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:59.759510 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9eb71975-3d4d-4493-86a6-4ab47fd0c19a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:59.765788 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9eb71975-3d4d-4493-86a6-4ab47fd0c19a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:59.766272 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9eb71975-3d4d-4493-86a6-4ab47fd0c19a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:59.767034 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9eb71975-3d4d-4493-86a6-4ab47fd0c19a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:59.767960 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9eb71975-3d4d-4493-86a6-4ab47fd0c19a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:59.844494 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8db92efc-3ea4-40b0-a7e0-52a467626a0a tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:31:59.846325 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8db92efc-3ea4-40b0-a7e0-52a467626a0a tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:31:59.853996 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8db92efc-3ea4-40b0-a7e0-52a467626a0a tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:59.854498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8db92efc-3ea4-40b0-a7e0-52a467626a0a tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:59.855329 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8db92efc-3ea4-40b0-a7e0-52a467626a0a tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:31:59.855800 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8db92efc-3ea4-40b0-a7e0-52a467626a0a tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:31:59.917122 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9eb71975-3d4d-4493-86a6-4ab47fd0c19a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:31:59.928219 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9eb71975-3d4d-4493-86a6-4ab47fd0c19a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1265 microversion: 2.1 time: 0.172939 Nov 12 02:31:59.928797 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 449/925] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:59 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:00.004578 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8db92efc-3ea4-40b0-a7e0-52a467626a0a tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:00.011742 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8db92efc-3ea4-40b0-a7e0-52a467626a0a tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1507 microversion: 2.1 time: 0.171272 Nov 12 02:32:00.012306 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 477/926] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:31:59 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:32:00.818704 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dd958185-02c2-4ca1-b5a6-7f69f234d30d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:00.820389 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dd958185-02c2-4ca1-b5a6-7f69f234d30d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:00.827769 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd958185-02c2-4ca1-b5a6-7f69f234d30d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:00.828317 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd958185-02c2-4ca1-b5a6-7f69f234d30d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:00.829329 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd958185-02c2-4ca1-b5a6-7f69f234d30d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:00.829975 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd958185-02c2-4ca1-b5a6-7f69f234d30d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:00.923023 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-dd958185-02c2-4ca1-b5a6-7f69f234d30d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lazy-loading 'services' on Instance uuid 5c1ce3bd-1739-49be-ab2e-e81c1026ae30 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:32:00.946246 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-210c918c-3d78-4b30-9654-c9a7343cf0fd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:00.947346 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-210c918c-3d78-4b30-9654-c9a7343cf0fd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:00.955511 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-210c918c-3d78-4b30-9654-c9a7343cf0fd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:00.955869 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-210c918c-3d78-4b30-9654-c9a7343cf0fd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:00.956903 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-210c918c-3d78-4b30-9654-c9a7343cf0fd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:00.957380 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-210c918c-3d78-4b30-9654-c9a7343cf0fd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:00.999552 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dd958185-02c2-4ca1-b5a6-7f69f234d30d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/os-volume_attachments/783f9c4f-7300-4a92-9cf5-742c0f50665e" status: 202 len: 0 microversion: 2.1 time: 0.307458 Nov 12 02:32:01.000132 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 450/927] 10.222.0.70 () {58 vars in 1415 bytes} [Fri Nov 12 02:32:00 2021] DELETE /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/os-volume_attachments/783f9c4f-7300-4a92-9cf5-742c0f50665e => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:32:01.129980 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-210c918c-3d78-4b30-9654-c9a7343cf0fd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:01.137908 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-210c918c-3d78-4b30-9654-c9a7343cf0fd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1265 microversion: 2.1 time: 0.195131 Nov 12 02:32:01.138487 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 478/928] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:00 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:02.133053 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9dd3dd1a-c927-4a5c-bfd0-e16143a944ca tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:32:02.140015 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9dd3dd1a-c927-4a5c-bfd0-e16143a944ca tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:02.140472 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9dd3dd1a-c927-4a5c-bfd0-e16143a944ca tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:02.155741 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-56e9eb94-9a16-46ee-8976-d06949bf8870 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:02.156355 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-56e9eb94-9a16-46ee-8976-d06949bf8870 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:02.163394 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9dd3dd1a-c927-4a5c-bfd0-e16143a944ca tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Going to try to stop instance {{(pid=116098) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 12 02:32:02.164242 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-56e9eb94-9a16-46ee-8976-d06949bf8870 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:02.164781 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-56e9eb94-9a16-46ee-8976-d06949bf8870 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:02.166304 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-56e9eb94-9a16-46ee-8976-d06949bf8870 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:02.166973 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-56e9eb94-9a16-46ee-8976-d06949bf8870 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:02.225757 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9dd3dd1a-c927-4a5c-bfd0-e16143a944ca tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 202 len: 0 microversion: 2.1 time: 0.103536 Nov 12 02:32:02.226558 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 451/929] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:32:02 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:32:02.234778 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c81a85a2-353f-41d2-bf1b-6cef3797ead5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:02.235483 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c81a85a2-353f-41d2-bf1b-6cef3797ead5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:02.242105 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c81a85a2-353f-41d2-bf1b-6cef3797ead5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:02.242841 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c81a85a2-353f-41d2-bf1b-6cef3797ead5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:02.243626 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c81a85a2-353f-41d2-bf1b-6cef3797ead5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:02.244054 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c81a85a2-353f-41d2-bf1b-6cef3797ead5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:02.361069 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-56e9eb94-9a16-46ee-8976-d06949bf8870 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:02.375039 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-56e9eb94-9a16-46ee-8976-d06949bf8870 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1265 microversion: 2.1 time: 0.220158 Nov 12 02:32:02.379216 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 479/930] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:02 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:32:02.429521 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c81a85a2-353f-41d2-bf1b-6cef3797ead5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:02.436771 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c81a85a2-353f-41d2-bf1b-6cef3797ead5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1674 microversion: 2.1 time: 0.205824 Nov 12 02:32:02.437350 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 452/931] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:02 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1674 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:03.393619 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-71ea0f4c-d5af-40e6-a2a0-72f12baa6f13 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:03.394372 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-71ea0f4c-d5af-40e6-a2a0-72f12baa6f13 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:03.401842 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-71ea0f4c-d5af-40e6-a2a0-72f12baa6f13 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:03.402440 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-71ea0f4c-d5af-40e6-a2a0-72f12baa6f13 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:03.403398 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-71ea0f4c-d5af-40e6-a2a0-72f12baa6f13 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:03.403981 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-71ea0f4c-d5af-40e6-a2a0-72f12baa6f13 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:03.457009 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fb4752b4-bbf6-42f6-8f95-2065d31ba6a3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:03.457625 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fb4752b4-bbf6-42f6-8f95-2065d31ba6a3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:03.464640 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fb4752b4-bbf6-42f6-8f95-2065d31ba6a3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:03.465439 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fb4752b4-bbf6-42f6-8f95-2065d31ba6a3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:03.466414 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fb4752b4-bbf6-42f6-8f95-2065d31ba6a3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:03.467031 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fb4752b4-bbf6-42f6-8f95-2065d31ba6a3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:03.581072 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-71ea0f4c-d5af-40e6-a2a0-72f12baa6f13 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:03.588529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-71ea0f4c-d5af-40e6-a2a0-72f12baa6f13 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1265 microversion: 2.1 time: 0.199589 Nov 12 02:32:03.589271 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 480/932] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:03 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:03.647825 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fb4752b4-bbf6-42f6-8f95-2065d31ba6a3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:03.655177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fb4752b4-bbf6-42f6-8f95-2065d31ba6a3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1674 microversion: 2.1 time: 0.202878 Nov 12 02:32:03.655778 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 453/933] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:03 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1674 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:04.605257 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-712be611-a32c-4b79-9bbc-31637c176196 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:04.606932 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-712be611-a32c-4b79-9bbc-31637c176196 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:04.613973 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-712be611-a32c-4b79-9bbc-31637c176196 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:04.622537 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-712be611-a32c-4b79-9bbc-31637c176196 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:04.623508 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-712be611-a32c-4b79-9bbc-31637c176196 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:04.624045 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-712be611-a32c-4b79-9bbc-31637c176196 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:04.673069 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b46e3811-17c8-415a-af36-da994f493a7f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:04.674395 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b46e3811-17c8-415a-af36-da994f493a7f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:04.680675 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b46e3811-17c8-415a-af36-da994f493a7f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:04.681131 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b46e3811-17c8-415a-af36-da994f493a7f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:04.682276 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b46e3811-17c8-415a-af36-da994f493a7f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:04.682512 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b46e3811-17c8-415a-af36-da994f493a7f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:04.861167 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-712be611-a32c-4b79-9bbc-31637c176196 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:04.871096 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-712be611-a32c-4b79-9bbc-31637c176196 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1265 microversion: 2.1 time: 0.269630 Nov 12 02:32:04.882374 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 481/934] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:04 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:04.907022 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b46e3811-17c8-415a-af36-da994f493a7f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:04.917661 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b46e3811-17c8-415a-af36-da994f493a7f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1674 microversion: 2.1 time: 0.248304 Nov 12 02:32:04.918265 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 454/935] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:04 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1674 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:32:05.889504 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b8f1abd3-8642-4a31-8bf5-2c501f568e3a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:05.890857 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b8f1abd3-8642-4a31-8bf5-2c501f568e3a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:05.899686 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b8f1abd3-8642-4a31-8bf5-2c501f568e3a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:05.900326 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b8f1abd3-8642-4a31-8bf5-2c501f568e3a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:05.901370 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b8f1abd3-8642-4a31-8bf5-2c501f568e3a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:05.901978 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b8f1abd3-8642-4a31-8bf5-2c501f568e3a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:05.937812 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-313a457d-d424-48ea-8a56-60bad9057637 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:05.938994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-313a457d-d424-48ea-8a56-60bad9057637 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:05.945619 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-313a457d-d424-48ea-8a56-60bad9057637 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:05.946063 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-313a457d-d424-48ea-8a56-60bad9057637 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:05.946869 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-313a457d-d424-48ea-8a56-60bad9057637 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:05.947299 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-313a457d-d424-48ea-8a56-60bad9057637 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:06.088211 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b8f1abd3-8642-4a31-8bf5-2c501f568e3a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:06.096750 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b8f1abd3-8642-4a31-8bf5-2c501f568e3a tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1265 microversion: 2.1 time: 0.211991 Nov 12 02:32:06.097339 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 482/936] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:05 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:06.136792 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-313a457d-d424-48ea-8a56-60bad9057637 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:06.144845 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-313a457d-d424-48ea-8a56-60bad9057637 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1674 microversion: 2.1 time: 0.212226 Nov 12 02:32:06.145428 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 455/937] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:05 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1674 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:32:06.790430 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-67a32fe4-e0f1-4aa2-877d-85d849045149 req-827e5759-2f19-49d3-a647-d613aa03ef3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b66789-7ae5-4589-bd84-3539cf00e97f", "name": "network-vif-plugged", "status": "completed", "tag": "9ea72f7b-3a91-4bd5-9bee-cf36f50653a8"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:32:06.792088 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:32:06.792088 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:32:06.800421 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-67a32fe4-e0f1-4aa2-877d-85d849045149 req-827e5759-2f19-49d3-a647-d613aa03ef3b service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:06.800935 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-67a32fe4-e0f1-4aa2-877d-85d849045149 req-827e5759-2f19-49d3-a647-d613aa03ef3b service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:06.812599 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-67a32fe4-e0f1-4aa2-877d-85d849045149 req-827e5759-2f19-49d3-a647-d613aa03ef3b service nova] Creating event network-vif-plugged:9ea72f7b-3a91-4bd5-9bee-cf36f50653a8 for instance 41b66789-7ae5-4589-bd84-3539cf00e97f on hv-cinder-80857 Nov 12 02:32:06.817905 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-67a32fe4-e0f1-4aa2-877d-85d849045149 req-827e5759-2f19-49d3-a647-d613aa03ef3b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031163 Nov 12 02:32:06.818506 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 483/938] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:32:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:32:07.113527 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3f96af3a-13c5-4eaf-a23a-1b2d3d6e1e81 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:07.114125 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3f96af3a-13c5-4eaf-a23a-1b2d3d6e1e81 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:07.122024 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3f96af3a-13c5-4eaf-a23a-1b2d3d6e1e81 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:07.122475 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3f96af3a-13c5-4eaf-a23a-1b2d3d6e1e81 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:07.123292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3f96af3a-13c5-4eaf-a23a-1b2d3d6e1e81 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:07.123729 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3f96af3a-13c5-4eaf-a23a-1b2d3d6e1e81 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:07.162607 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5bd97a17-f651-4c6b-916c-afcc6e3482f5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:07.163488 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5bd97a17-f651-4c6b-916c-afcc6e3482f5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:07.170568 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5bd97a17-f651-4c6b-916c-afcc6e3482f5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:07.171295 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5bd97a17-f651-4c6b-916c-afcc6e3482f5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:07.172090 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5bd97a17-f651-4c6b-916c-afcc6e3482f5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:07.172655 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5bd97a17-f651-4c6b-916c-afcc6e3482f5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:07.307582 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3f96af3a-13c5-4eaf-a23a-1b2d3d6e1e81 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:07.317613 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3f96af3a-13c5-4eaf-a23a-1b2d3d6e1e81 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1265 microversion: 2.1 time: 0.207788 Nov 12 02:32:07.318216 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 456/939] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:07 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:07.349777 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5bd97a17-f651-4c6b-916c-afcc6e3482f5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:07.357149 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5bd97a17-f651-4c6b-916c-afcc6e3482f5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1674 microversion: 2.1 time: 0.199582 Nov 12 02:32:07.357723 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 484/940] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:07 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1674 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:08.334794 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-410b047e-5c09-4375-8fa0-2127e45edf1d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:08.335392 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-410b047e-5c09-4375-8fa0-2127e45edf1d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:08.341632 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-410b047e-5c09-4375-8fa0-2127e45edf1d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:08.342079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-410b047e-5c09-4375-8fa0-2127e45edf1d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:08.342877 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-410b047e-5c09-4375-8fa0-2127e45edf1d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:08.343306 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-410b047e-5c09-4375-8fa0-2127e45edf1d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:08.374096 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-793e06f1-9a49-4a43-93a5-1ca568687e98 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:08.374761 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-793e06f1-9a49-4a43-93a5-1ca568687e98 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:08.381982 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-793e06f1-9a49-4a43-93a5-1ca568687e98 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:08.382445 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-793e06f1-9a49-4a43-93a5-1ca568687e98 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:08.383256 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-793e06f1-9a49-4a43-93a5-1ca568687e98 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:08.383897 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-793e06f1-9a49-4a43-93a5-1ca568687e98 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:08.540929 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-410b047e-5c09-4375-8fa0-2127e45edf1d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:08.548414 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-410b047e-5c09-4375-8fa0-2127e45edf1d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1265 microversion: 2.1 time: 0.217545 Nov 12 02:32:08.549612 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 457/941] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:08 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:08.571087 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-793e06f1-9a49-4a43-93a5-1ca568687e98 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:08.578567 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-793e06f1-9a49-4a43-93a5-1ca568687e98 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1674 microversion: 2.1 time: 0.207942 Nov 12 02:32:08.579188 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 485/942] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:08 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1674 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:32:09.565751 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ac8fe4da-e42e-4a90-a737-6f742fb694c1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:09.566326 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ac8fe4da-e42e-4a90-a737-6f742fb694c1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:09.572831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac8fe4da-e42e-4a90-a737-6f742fb694c1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:09.573274 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac8fe4da-e42e-4a90-a737-6f742fb694c1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:09.574227 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac8fe4da-e42e-4a90-a737-6f742fb694c1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:09.574682 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ac8fe4da-e42e-4a90-a737-6f742fb694c1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:09.598513 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-69b2deb3-8089-4446-9787-3448597b1812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:09.598513 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-69b2deb3-8089-4446-9787-3448597b1812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:09.604184 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-69b2deb3-8089-4446-9787-3448597b1812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:09.604629 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-69b2deb3-8089-4446-9787-3448597b1812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:09.605421 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-69b2deb3-8089-4446-9787-3448597b1812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:09.605859 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-69b2deb3-8089-4446-9787-3448597b1812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:09.774364 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ac8fe4da-e42e-4a90-a737-6f742fb694c1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:09.782355 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ac8fe4da-e42e-4a90-a737-6f742fb694c1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1451 microversion: 2.1 time: 0.220122 Nov 12 02:32:09.783695 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 458/943] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:09 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1451 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:09.800756 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-07591bbb-0105-486b-9ac7-347c033c48f3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:09.801385 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-07591bbb-0105-486b-9ac7-347c033c48f3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:09.804763 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-69b2deb3-8089-4446-9787-3448597b1812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:09.807669 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-07591bbb-0105-486b-9ac7-347c033c48f3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:09.808118 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-07591bbb-0105-486b-9ac7-347c033c48f3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:09.808968 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-07591bbb-0105-486b-9ac7-347c033c48f3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:09.809466 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-07591bbb-0105-486b-9ac7-347c033c48f3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:09.813005 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-69b2deb3-8089-4446-9787-3448597b1812 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1674 microversion: 2.1 time: 0.221066 Nov 12 02:32:09.813845 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 486/944] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:09 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1674 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:32:09.962285 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-07591bbb-0105-486b-9ac7-347c033c48f3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:09.971979 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-07591bbb-0105-486b-9ac7-347c033c48f3 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1451 microversion: 2.1 time: 0.175188 Nov 12 02:32:09.972554 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 459/945] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:09 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:10.830728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-aca886d7-84fc-461c-bdf2-12189bc6f2d8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:10.832015 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-aca886d7-84fc-461c-bdf2-12189bc6f2d8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:10.838877 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aca886d7-84fc-461c-bdf2-12189bc6f2d8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:10.839330 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aca886d7-84fc-461c-bdf2-12189bc6f2d8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:10.840135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aca886d7-84fc-461c-bdf2-12189bc6f2d8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:10.840619 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aca886d7-84fc-461c-bdf2-12189bc6f2d8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:11.032882 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-aca886d7-84fc-461c-bdf2-12189bc6f2d8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:11.041934 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-aca886d7-84fc-461c-bdf2-12189bc6f2d8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1674 microversion: 2.1 time: 0.214997 Nov 12 02:32:11.042788 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 487/946] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:10 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1674 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:32:12.058649 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f434da2d-495d-4859-a3a9-3e5ade3b25a9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:12.059292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f434da2d-495d-4859-a3a9-3e5ade3b25a9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:12.066484 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f434da2d-495d-4859-a3a9-3e5ade3b25a9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:12.066963 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f434da2d-495d-4859-a3a9-3e5ade3b25a9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:12.067758 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f434da2d-495d-4859-a3a9-3e5ade3b25a9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:12.068389 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f434da2d-495d-4859-a3a9-3e5ade3b25a9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:12.233669 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-108034b1-61d4-4462-b4dc-3155c320a628 req-7999bcad-4711-404f-8d7e-5befa100765b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b66789-7ae5-4589-bd84-3539cf00e97f", "tag": "9ea72f7b-3a91-4bd5-9bee-cf36f50653a8"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:32:12.235662 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:32:12.235662 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:32:12.243434 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f434da2d-495d-4859-a3a9-3e5ade3b25a9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:12.250370 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-108034b1-61d4-4462-b4dc-3155c320a628 req-7999bcad-4711-404f-8d7e-5befa100765b service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:12.251168 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-108034b1-61d4-4462-b4dc-3155c320a628 req-7999bcad-4711-404f-8d7e-5befa100765b service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:12.259306 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f434da2d-495d-4859-a3a9-3e5ade3b25a9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1674 microversion: 2.1 time: 0.204277 Nov 12 02:32:12.260213 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 460/947] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:12 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:12.270857 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-108034b1-61d4-4462-b4dc-3155c320a628 req-7999bcad-4711-404f-8d7e-5befa100765b service nova] Creating event network-changed:9ea72f7b-3a91-4bd5-9bee-cf36f50653a8 for instance 41b66789-7ae5-4589-bd84-3539cf00e97f on hv-cinder-80857 Nov 12 02:32:12.276262 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-108034b1-61d4-4462-b4dc-3155c320a628 req-7999bcad-4711-404f-8d7e-5befa100765b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047328 Nov 12 02:32:12.276994 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 488/948] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:32:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:32:13.277275 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5a34f857-f6b2-464c-aa0f-fc2f044b5e1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:13.277989 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5a34f857-f6b2-464c-aa0f-fc2f044b5e1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:13.284895 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a34f857-f6b2-464c-aa0f-fc2f044b5e1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:13.285337 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a34f857-f6b2-464c-aa0f-fc2f044b5e1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:13.286119 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a34f857-f6b2-464c-aa0f-fc2f044b5e1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:13.286546 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a34f857-f6b2-464c-aa0f-fc2f044b5e1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:13.443882 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5a34f857-f6b2-464c-aa0f-fc2f044b5e1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:13.452339 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5a34f857-f6b2-464c-aa0f-fc2f044b5e1f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1651 microversion: 2.1 time: 0.178649 Nov 12 02:32:13.452916 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 461/949] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:13 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1651 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:32:13.470353 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4e6e1239-b64a-497f-94d6-71c7e2d75412 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:32:13.477964 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e6e1239-b64a-497f-94d6-71c7e2d75412 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:13.477964 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e6e1239-b64a-497f-94d6-71c7e2d75412 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:13.544448 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4e6e1239-b64a-497f-94d6-71c7e2d75412 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Going to try to start instance {{(pid=116099) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 12 02:32:13.592344 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4e6e1239-b64a-497f-94d6-71c7e2d75412 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action" status: 202 len: 0 microversion: 2.1 time: 0.126523 Nov 12 02:32:13.593038 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 489/950] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:32:13 2021] POST /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:32:13.601785 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4e0508d8-b80b-41e0-81dd-bf54f2323a5e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:13.602626 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4e0508d8-b80b-41e0-81dd-bf54f2323a5e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:13.609096 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e0508d8-b80b-41e0-81dd-bf54f2323a5e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:13.610017 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e0508d8-b80b-41e0-81dd-bf54f2323a5e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:13.611292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e0508d8-b80b-41e0-81dd-bf54f2323a5e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:13.611923 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4e0508d8-b80b-41e0-81dd-bf54f2323a5e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:13.768632 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4e0508d8-b80b-41e0-81dd-bf54f2323a5e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:13.777645 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4e0508d8-b80b-41e0-81dd-bf54f2323a5e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1660 microversion: 2.1 time: 0.179399 Nov 12 02:32:13.778571 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 462/951] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:13 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1660 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:32:14.795831 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d5aed4d7-af15-4d98-9584-4040e1e57cfe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:14.796671 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d5aed4d7-af15-4d98-9584-4040e1e57cfe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:14.803133 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d5aed4d7-af15-4d98-9584-4040e1e57cfe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:14.803592 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d5aed4d7-af15-4d98-9584-4040e1e57cfe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:14.804369 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d5aed4d7-af15-4d98-9584-4040e1e57cfe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:14.804809 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d5aed4d7-af15-4d98-9584-4040e1e57cfe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:14.943355 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d5aed4d7-af15-4d98-9584-4040e1e57cfe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:14.950610 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d5aed4d7-af15-4d98-9584-4040e1e57cfe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1660 microversion: 2.1 time: 0.158752 Nov 12 02:32:14.951197 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 490/952] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:14 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1660 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:15.968497 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bb55e5f3-fb77-4262-9064-75abefd31183 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:32:15.969096 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bb55e5f3-fb77-4262-9064-75abefd31183 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:15.975318 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb55e5f3-fb77-4262-9064-75abefd31183 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:15.975768 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb55e5f3-fb77-4262-9064-75abefd31183 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:15.976544 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb55e5f3-fb77-4262-9064-75abefd31183 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:15.976978 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb55e5f3-fb77-4262-9064-75abefd31183 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:16.112748 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bb55e5f3-fb77-4262-9064-75abefd31183 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:32:16.121671 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bb55e5f3-fb77-4262-9064-75abefd31183 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1664 microversion: 2.1 time: 0.156870 Nov 12 02:32:16.122273 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 463/953] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:32:15 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:32:30.860479 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1a12ffaa-0684-4dd2-85a1-7ae8fd1973d9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3bba4c1-5901-458e-80d0-6866a4242abf", "device": "/dev/sdb"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:32:30.862058 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1a12ffaa-0684-4dd2-85a1-7ae8fd1973d9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:32:30.868622 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a12ffaa-0684-4dd2-85a1-7ae8fd1973d9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:30.869071 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a12ffaa-0684-4dd2-85a1-7ae8fd1973d9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:30.869870 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a12ffaa-0684-4dd2-85a1-7ae8fd1973d9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:32:30.870302 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a12ffaa-0684-4dd2-85a1-7ae8fd1973d9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:32:31.115413 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1a12ffaa-0684-4dd2-85a1-7ae8fd1973d9 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "POST /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258563 Nov 12 02:32:31.116021 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 491/954] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:32:30 2021] POST /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:33:00.648848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:33:00.649593 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: Fri Nov 12 02:33:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:33:01.032022 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:33:01.032651 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: Fri Nov 12 02:33:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:33:10.085856 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ccb54b55-48ba-45ee-89c2-3e71e0f5aac2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:10.086471 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ccb54b55-48ba-45ee-89c2-3e71e0f5aac2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:10.092290 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ccb54b55-48ba-45ee-89c2-3e71e0f5aac2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:10.092743 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ccb54b55-48ba-45ee-89c2-3e71e0f5aac2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:10.093527 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ccb54b55-48ba-45ee-89c2-3e71e0f5aac2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:10.094036 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ccb54b55-48ba-45ee-89c2-3e71e0f5aac2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:10.174215 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-ccb54b55-48ba-45ee-89c2-3e71e0f5aac2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lazy-loading 'services' on Instance uuid b806f575-4671-4182-825f-c3c0b1a3122d {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:33:10.248592 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ccb54b55-48ba-45ee-89c2-3e71e0f5aac2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d/os-volume_attachments/a3bba4c1-5901-458e-80d0-6866a4242abf" status: 202 len: 0 microversion: 2.1 time: 0.166466 Nov 12 02:33:10.249197 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 464/955] 10.222.0.70 () {58 vars in 1415 bytes} [Fri Nov 12 02:33:10 2021] DELETE /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d/os-volume_attachments/a3bba4c1-5901-458e-80d0-6866a4242abf => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:33:12.410842 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a056ef49-4ac4-40e9-a53d-7f9216101be7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:12.411433 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a056ef49-4ac4-40e9-a53d-7f9216101be7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:12.417400 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a056ef49-4ac4-40e9-a53d-7f9216101be7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:12.417845 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a056ef49-4ac4-40e9-a53d-7f9216101be7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:12.418616 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a056ef49-4ac4-40e9-a53d-7f9216101be7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:12.419075 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a056ef49-4ac4-40e9-a53d-7f9216101be7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:12.446469 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a056ef49-4ac4-40e9-a53d-7f9216101be7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Going to try to terminate instance {{(pid=116099) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:33:12.520042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a056ef49-4ac4-40e9-a53d-7f9216101be7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 204 len: 0 microversion: 2.1 time: 0.113248 Nov 12 02:33:12.520723 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 492/956] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:33:12 2021] DELETE /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:33:12.529566 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f73a602b-3d0a-4481-be24-24d539ea1fd2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:12.530357 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f73a602b-3d0a-4481-be24-24d539ea1fd2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:12.537044 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f73a602b-3d0a-4481-be24-24d539ea1fd2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:12.537561 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f73a602b-3d0a-4481-be24-24d539ea1fd2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:12.538404 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f73a602b-3d0a-4481-be24-24d539ea1fd2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:12.538964 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f73a602b-3d0a-4481-be24-24d539ea1fd2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:12.669529 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f73a602b-3d0a-4481-be24-24d539ea1fd2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:12.677571 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f73a602b-3d0a-4481-be24-24d539ea1fd2 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1513 microversion: 2.1 time: 0.151880 Nov 12 02:33:12.680630 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 465/957] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:12 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:13.700438 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-073a1ccd-e9c5-4af3-a67a-0d18fcdeb43e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:13.701195 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-073a1ccd-e9c5-4af3-a67a-0d18fcdeb43e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:13.708335 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-073a1ccd-e9c5-4af3-a67a-0d18fcdeb43e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:13.708781 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-073a1ccd-e9c5-4af3-a67a-0d18fcdeb43e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:13.709564 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-073a1ccd-e9c5-4af3-a67a-0d18fcdeb43e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:13.709993 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-073a1ccd-e9c5-4af3-a67a-0d18fcdeb43e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:13.845912 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-073a1ccd-e9c5-4af3-a67a-0d18fcdeb43e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:13.853156 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-073a1ccd-e9c5-4af3-a67a-0d18fcdeb43e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1513 microversion: 2.1 time: 0.157012 Nov 12 02:33:13.853716 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 493/958] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:13 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:14.871033 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-122850dc-4641-4ec4-9906-3cd24e3e8636 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:14.871644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-122850dc-4641-4ec4-9906-3cd24e3e8636 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:14.877829 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-122850dc-4641-4ec4-9906-3cd24e3e8636 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:14.878272 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-122850dc-4641-4ec4-9906-3cd24e3e8636 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:14.879065 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-122850dc-4641-4ec4-9906-3cd24e3e8636 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:14.879502 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-122850dc-4641-4ec4-9906-3cd24e3e8636 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:15.009924 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-122850dc-4641-4ec4-9906-3cd24e3e8636 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:15.017031 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-122850dc-4641-4ec4-9906-3cd24e3e8636 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1513 microversion: 2.1 time: 0.149944 Nov 12 02:33:15.018078 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 466/959] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:14 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:16.034634 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4dadafff-469e-4e3e-89d7-a24827964abb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:16.035199 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4dadafff-469e-4e3e-89d7-a24827964abb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:16.041476 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4dadafff-469e-4e3e-89d7-a24827964abb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:16.041927 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4dadafff-469e-4e3e-89d7-a24827964abb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:16.042736 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4dadafff-469e-4e3e-89d7-a24827964abb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:16.043175 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4dadafff-469e-4e3e-89d7-a24827964abb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:16.171914 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4dadafff-469e-4e3e-89d7-a24827964abb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:16.179900 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4dadafff-469e-4e3e-89d7-a24827964abb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1513 microversion: 2.1 time: 0.149548 Nov 12 02:33:16.180467 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 494/960] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:16 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:17.196401 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7ba45ef9-ffa4-4536-ac32-74a25d30a8bc tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:17.197016 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7ba45ef9-ffa4-4536-ac32-74a25d30a8bc tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:17.203242 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7ba45ef9-ffa4-4536-ac32-74a25d30a8bc tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:17.203683 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7ba45ef9-ffa4-4536-ac32-74a25d30a8bc tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:17.204439 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7ba45ef9-ffa4-4536-ac32-74a25d30a8bc tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:17.204869 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7ba45ef9-ffa4-4536-ac32-74a25d30a8bc tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:17.335726 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7ba45ef9-ffa4-4536-ac32-74a25d30a8bc tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:17.343090 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7ba45ef9-ffa4-4536-ac32-74a25d30a8bc tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1513 microversion: 2.1 time: 0.150245 Nov 12 02:33:17.343669 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 467/961] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:17 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:18.362017 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b9057676-f5fd-428e-9d1e-1eff3ef65034 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:18.362017 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b9057676-f5fd-428e-9d1e-1eff3ef65034 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:18.370896 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b9057676-f5fd-428e-9d1e-1eff3ef65034 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:18.371404 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b9057676-f5fd-428e-9d1e-1eff3ef65034 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:18.372201 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b9057676-f5fd-428e-9d1e-1eff3ef65034 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:18.372635 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b9057676-f5fd-428e-9d1e-1eff3ef65034 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:18.516534 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b9057676-f5fd-428e-9d1e-1eff3ef65034 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:18.524392 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b9057676-f5fd-428e-9d1e-1eff3ef65034 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 200 len: 1513 microversion: 2.1 time: 0.166856 Nov 12 02:33:18.524971 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 495/962] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:18 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:18.610256 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-d6a813f6-e764-4596-97ba-852c84f33ea4 req-17d1e04a-cb3a-4204-9ed1-38dc380d8d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b806f575-4671-4182-825f-c3c0b1a3122d", "name": "network-vif-deleted", "tag": "0505075a-de86-4382-954f-d4b52a1d0777"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:18.613177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:33:18.613177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:33:18.623002 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-d6a813f6-e764-4596-97ba-852c84f33ea4 req-17d1e04a-cb3a-4204-9ed1-38dc380d8d69 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:18.623442 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-d6a813f6-e764-4596-97ba-852c84f33ea4 req-17d1e04a-cb3a-4204-9ed1-38dc380d8d69 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:18.637834 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-d6a813f6-e764-4596-97ba-852c84f33ea4 req-17d1e04a-cb3a-4204-9ed1-38dc380d8d69 service nova] Creating event network-vif-deleted:0505075a-de86-4382-954f-d4b52a1d0777 for instance b806f575-4671-4182-825f-c3c0b1a3122d on hv-cinder-80857 Nov 12 02:33:18.644231 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-d6a813f6-e764-4596-97ba-852c84f33ea4 req-17d1e04a-cb3a-4204-9ed1-38dc380d8d69 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037208 Nov 12 02:33:18.645259 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 468/963] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:33:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:33:19.541951 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-31c839f0-0216-4246-97c3-6503cd4495cd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:19.542693 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-31c839f0-0216-4246-97c3-6503cd4495cd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: b806f575-4671-4182-825f-c3c0b1a3122d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:19.549060 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-31c839f0-0216-4246-97c3-6503cd4495cd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:19.549509 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-31c839f0-0216-4246-97c3-6503cd4495cd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:19.550283 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-31c839f0-0216-4246-97c3-6503cd4495cd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:19.550743 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-31c839f0-0216-4246-97c3-6503cd4495cd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:19.565788 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-31c839f0-0216-4246-97c3-6503cd4495cd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] HTTP exception thrown: Instance b806f575-4671-4182-825f-c3c0b1a3122d could not be found. Nov 12 02:33:19.566387 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-31c839f0-0216-4246-97c3-6503cd4495cd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Returning 404 to user: Instance b806f575-4671-4182-825f-c3c0b1a3122d could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:33:19.567243 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-31c839f0-0216-4246-97c3-6503cd4495cd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d" status: 404 len: 111 microversion: 2.1 time: 0.029173 Nov 12 02:33:19.567810 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 496/964] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:19 2021] GET /compute/v2.1/servers/b806f575-4671-4182-825f-c3c0b1a3122d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:33:30.172461 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b4d79022-1069-47e7-a8e8-0d579153d23b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:30.173072 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b4d79022-1069-47e7-a8e8-0d579153d23b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:30.179790 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4d79022-1069-47e7-a8e8-0d579153d23b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:30.180238 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4d79022-1069-47e7-a8e8-0d579153d23b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:30.181017 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4d79022-1069-47e7-a8e8-0d579153d23b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:30.181450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b4d79022-1069-47e7-a8e8-0d579153d23b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:30.210991 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b4d79022-1069-47e7-a8e8-0d579153d23b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/os-volume_attachments/a3b11ee5-ef9c-4ac0-bde6-de69a347da06" status: 200 len: 194 microversion: 2.20 time: 0.042570 Nov 12 02:33:30.211593 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 469/965] 10.222.0.70 () {60 vars in 1453 bytes} [Fri Nov 12 02:33:30 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/os-volume_attachments/a3b11ee5-ef9c-4ac0-bde6-de69a347da06 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:33:30.272379 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-87f1acad-4657-44d4-bd6a-e25e6b1d1fdd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:30.272911 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-87f1acad-4657-44d4-bd6a-e25e6b1d1fdd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:30.279138 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-87f1acad-4657-44d4-bd6a-e25e6b1d1fdd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:30.279616 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-87f1acad-4657-44d4-bd6a-e25e6b1d1fdd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:30.280392 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-87f1acad-4657-44d4-bd6a-e25e6b1d1fdd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:30.280819 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-87f1acad-4657-44d4-bd6a-e25e6b1d1fdd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:30.358254 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-87f1acad-4657-44d4-bd6a-e25e6b1d1fdd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lazy-loading 'services' on Instance uuid 26d16c68-a04c-4a32-a599-e202e6c64152 {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:33:30.431624 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-87f1acad-4657-44d4-bd6a-e25e6b1d1fdd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "DELETE /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/os-volume_attachments/a3b11ee5-ef9c-4ac0-bde6-de69a347da06" status: 202 len: 0 microversion: 2.20 time: 0.163359 Nov 12 02:33:30.435493 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 497/966] 10.222.0.70 () {60 vars in 1456 bytes} [Fri Nov 12 02:33:30 2021] DELETE /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/os-volume_attachments/a3b11ee5-ef9c-4ac0-bde6-de69a347da06 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:33:30.441241 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-761a81c6-ec46-44b0-95c4-4d2326223a1d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:30.442352 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-761a81c6-ec46-44b0-95c4-4d2326223a1d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:30.448279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-761a81c6-ec46-44b0-95c4-4d2326223a1d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:30.448734 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-761a81c6-ec46-44b0-95c4-4d2326223a1d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:30.449519 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-761a81c6-ec46-44b0-95c4-4d2326223a1d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:30.449945 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-761a81c6-ec46-44b0-95c4-4d2326223a1d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:30.479158 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-761a81c6-ec46-44b0-95c4-4d2326223a1d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042264 Nov 12 02:33:30.480042 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 470/967] 10.222.0.70 () {60 vars in 1342 bytes} [Fri Nov 12 02:33:30 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:33:30.532199 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1820900844", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "networks": [{"uuid": "0f0e86fc-5462-49b5-aded-e18529b430ae"}]}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:30.583132 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.network.neutron [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] validate_networks() for [('0f0e86fc-5462-49b5-aded-e18529b430ae', None, None, None, None, None)] {{(pid=116099) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:33:30.944277 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Flavor limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:33:30.944704 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Image limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:33:30.945179 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Flavor pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:33:30.945595 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Image pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:33:30.946062 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:33:30.959091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:30.959533 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:30.960346 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:30.960778 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:30.977346 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Getting quotas for project a03794071c7f41db801753ddab2f9971. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:33:30.981329 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Getting quotas for user 58af07ec5a0c408faf8ccd6c7e9c0a88 and project a03794071c7f41db801753ddab2f9971. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:33:30.995543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Going to run 1 instances... {{(pid=116099) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:33:30.997974 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:33:31.052078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d32dd6a7-7a47-456a-b73d-5b5e78b4f0c5 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523880 Nov 12 02:33:31.052975 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 498/968] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:33:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:33:31.062780 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d6aeeadd-6fa6-46d5-acd5-1698713c7db7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:31.063442 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d6aeeadd-6fa6-46d5-acd5-1698713c7db7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:31.135584 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d6aeeadd-6fa6-46d5-acd5-1698713c7db7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:31.144988 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d6aeeadd-6fa6-46d5-acd5-1698713c7db7 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1219 microversion: 2.1 time: 0.083677 Nov 12 02:33:31.144988 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 471/969] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:31 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:33:31.496729 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-40e53de3-46b3-4195-9337-d2cb45557be6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:31.498148 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-40e53de3-46b3-4195-9337-d2cb45557be6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:31.505292 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-40e53de3-46b3-4195-9337-d2cb45557be6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:31.506063 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-40e53de3-46b3-4195-9337-d2cb45557be6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:31.506605 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-40e53de3-46b3-4195-9337-d2cb45557be6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:31.507079 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-40e53de3-46b3-4195-9337-d2cb45557be6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:31.542138 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-40e53de3-46b3-4195-9337-d2cb45557be6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052647 Nov 12 02:33:31.542823 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 499/970] 10.222.0.70 () {60 vars in 1342 bytes} [Fri Nov 12 02:33:31 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:31.617629 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ca129db1-b6b3-4ac4-a1ed-f579f5eb7722 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:31.618192 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ca129db1-b6b3-4ac4-a1ed-f579f5eb7722 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:31.624606 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca129db1-b6b3-4ac4-a1ed-f579f5eb7722 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:31.625054 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca129db1-b6b3-4ac4-a1ed-f579f5eb7722 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:31.625837 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca129db1-b6b3-4ac4-a1ed-f579f5eb7722 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:31.626272 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca129db1-b6b3-4ac4-a1ed-f579f5eb7722 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:31.657177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ca129db1-b6b3-4ac4-a1ed-f579f5eb7722 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:33:31.744570 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ca129db1-b6b3-4ac4-a1ed-f579f5eb7722 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "DELETE /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 204 len: 0 microversion: 2.20 time: 0.130684 Nov 12 02:33:31.745150 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 472/971] 10.222.0.70 () {60 vars in 1279 bytes} [Fri Nov 12 02:33:31 2021] DELETE /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 12 02:33:31.753106 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-cd759a13-a797-4b31-bcd8-06142fed0cf8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:31.753637 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-cd759a13-a797-4b31-bcd8-06142fed0cf8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:31.759646 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cd759a13-a797-4b31-bcd8-06142fed0cf8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:31.760092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cd759a13-a797-4b31-bcd8-06142fed0cf8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:31.760853 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cd759a13-a797-4b31-bcd8-06142fed0cf8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:31.761278 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cd759a13-a797-4b31-bcd8-06142fed0cf8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:31.894381 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cd759a13-a797-4b31-bcd8-06142fed0cf8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:31.902256 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cd759a13-a797-4b31-bcd8-06142fed0cf8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:31.903826 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cd759a13-a797-4b31-bcd8-06142fed0cf8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:31.904973 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-cd759a13-a797-4b31-bcd8-06142fed0cf8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.155637 Nov 12 02:33:31.905526 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 500/972] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:31 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:32.168788 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-25d17716-06dc-4eba-93a8-64015fa5d694 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:32.169588 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-25d17716-06dc-4eba-93a8-64015fa5d694 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:32.178070 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-25d17716-06dc-4eba-93a8-64015fa5d694 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:32.178526 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-25d17716-06dc-4eba-93a8-64015fa5d694 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:32.179356 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-25d17716-06dc-4eba-93a8-64015fa5d694 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:32.179966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-25d17716-06dc-4eba-93a8-64015fa5d694 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:32.250229 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-25d17716-06dc-4eba-93a8-64015fa5d694 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:32.261993 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-25d17716-06dc-4eba-93a8-64015fa5d694 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1279 microversion: 2.1 time: 0.103957 Nov 12 02:33:32.263335 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 473/973] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:32 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:32.924664 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-741dd2da-a8ac-4a06-95eb-d85fd30412aa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:32.925269 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-741dd2da-a8ac-4a06-95eb-d85fd30412aa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:32.931636 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-741dd2da-a8ac-4a06-95eb-d85fd30412aa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:32.932086 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-741dd2da-a8ac-4a06-95eb-d85fd30412aa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:32.932866 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-741dd2da-a8ac-4a06-95eb-d85fd30412aa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:32.933487 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-741dd2da-a8ac-4a06-95eb-d85fd30412aa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:33.072093 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-741dd2da-a8ac-4a06-95eb-d85fd30412aa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:33.079987 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-741dd2da-a8ac-4a06-95eb-d85fd30412aa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:33.081529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-741dd2da-a8ac-4a06-95eb-d85fd30412aa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:33.082686 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-741dd2da-a8ac-4a06-95eb-d85fd30412aa tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.162283 Nov 12 02:33:33.083255 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 501/974] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:32 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:33.291490 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fe66f5a0-2c6d-45de-a2c6-39601aa045c0 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:33.292548 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fe66f5a0-2c6d-45de-a2c6-39601aa045c0 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:33.299916 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fe66f5a0-2c6d-45de-a2c6-39601aa045c0 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:33.300353 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fe66f5a0-2c6d-45de-a2c6-39601aa045c0 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:33.301143 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fe66f5a0-2c6d-45de-a2c6-39601aa045c0 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:33.301597 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fe66f5a0-2c6d-45de-a2c6-39601aa045c0 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:33.464316 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fe66f5a0-2c6d-45de-a2c6-39601aa045c0 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:33.472851 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fe66f5a0-2c6d-45de-a2c6-39601aa045c0 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1319 microversion: 2.1 time: 0.187160 Nov 12 02:33:33.473479 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 474/975] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:33 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:33.598643 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-4308899b-4c66-4534-a36b-3ab55d78eef3 req-44dfdd62-a8d5-440c-8e4a-ddd4c6eb6075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf3408b-498b-451e-8349-0c35db7b987f", "tag": "41c1bb20-7b8a-4b47-82ed-3a6b9d01e401"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:33.600604 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:33:33.600604 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:33:33.607967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-4308899b-4c66-4534-a36b-3ab55d78eef3 req-44dfdd62-a8d5-440c-8e4a-ddd4c6eb6075 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:33.608640 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-4308899b-4c66-4534-a36b-3ab55d78eef3 req-44dfdd62-a8d5-440c-8e4a-ddd4c6eb6075 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:33.620548 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-4308899b-4c66-4534-a36b-3ab55d78eef3 req-44dfdd62-a8d5-440c-8e4a-ddd4c6eb6075 service nova] Creating event network-changed:41c1bb20-7b8a-4b47-82ed-3a6b9d01e401 for instance 5cf3408b-498b-451e-8349-0c35db7b987f on hv-cinder-80857 Nov 12 02:33:33.625464 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-4308899b-4c66-4534-a36b-3ab55d78eef3 req-44dfdd62-a8d5-440c-8e4a-ddd4c6eb6075 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032098 Nov 12 02:33:33.626049 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 502/976] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:33:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:33:34.100614 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cd924300-a8e6-42d1-9d16-6beb04967d6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:34.101255 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cd924300-a8e6-42d1-9d16-6beb04967d6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:34.107143 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd924300-a8e6-42d1-9d16-6beb04967d6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:34.107585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd924300-a8e6-42d1-9d16-6beb04967d6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:34.108373 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd924300-a8e6-42d1-9d16-6beb04967d6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:34.108806 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd924300-a8e6-42d1-9d16-6beb04967d6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:34.260837 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cd924300-a8e6-42d1-9d16-6beb04967d6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:34.268765 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cd924300-a8e6-42d1-9d16-6beb04967d6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:34.270279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cd924300-a8e6-42d1-9d16-6beb04967d6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:34.271483 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cd924300-a8e6-42d1-9d16-6beb04967d6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1722 microversion: 2.20 time: 0.174558 Nov 12 02:33:34.272254 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 475/977] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:34 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:34.492746 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-aeaa0f4d-a53f-4690-91b5-0cf9636859fd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:34.493471 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-aeaa0f4d-a53f-4690-91b5-0cf9636859fd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:34.507687 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aeaa0f4d-a53f-4690-91b5-0cf9636859fd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:34.508131 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aeaa0f4d-a53f-4690-91b5-0cf9636859fd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:34.508917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aeaa0f4d-a53f-4690-91b5-0cf9636859fd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:34.509348 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-aeaa0f4d-a53f-4690-91b5-0cf9636859fd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:35.029831 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-aeaa0f4d-a53f-4690-91b5-0cf9636859fd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:35.037750 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-aeaa0f4d-a53f-4690-91b5-0cf9636859fd tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1319 microversion: 2.1 time: 0.549807 Nov 12 02:33:35.038334 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 503/978] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:34 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1319 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:35.289471 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0fbf4441-53e7-448c-80bc-5ec47da42ff1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:35.290234 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0fbf4441-53e7-448c-80bc-5ec47da42ff1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:35.296658 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0fbf4441-53e7-448c-80bc-5ec47da42ff1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:35.297102 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0fbf4441-53e7-448c-80bc-5ec47da42ff1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:35.297891 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0fbf4441-53e7-448c-80bc-5ec47da42ff1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:35.298321 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0fbf4441-53e7-448c-80bc-5ec47da42ff1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:35.377738 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0fbf4441-53e7-448c-80bc-5ec47da42ff1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:35.386921 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0fbf4441-53e7-448c-80bc-5ec47da42ff1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:35.388419 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0fbf4441-53e7-448c-80bc-5ec47da42ff1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:35.389579 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0fbf4441-53e7-448c-80bc-5ec47da42ff1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 200 len: 1654 microversion: 2.20 time: 0.103844 Nov 12 02:33:35.390142 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 476/979] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:35 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 1654 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:35.533951 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-1e2f30d3-aef2-455a-b24f-9440f0b08654 req-c36d46b8-5883-4339-bd72-a020290fccef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d16c68-a04c-4a32-a599-e202e6c64152", "name": "network-vif-deleted", "tag": "6159a4de-08df-4c5b-afb6-bc1f4e2f213f"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:35.535616 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:33:35.535616 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:33:35.544899 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-1e2f30d3-aef2-455a-b24f-9440f0b08654 req-c36d46b8-5883-4339-bd72-a020290fccef service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:35.545353 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-1e2f30d3-aef2-455a-b24f-9440f0b08654 req-c36d46b8-5883-4339-bd72-a020290fccef service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:35.561407 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-1e2f30d3-aef2-455a-b24f-9440f0b08654 req-c36d46b8-5883-4339-bd72-a020290fccef service nova] Creating event network-vif-deleted:6159a4de-08df-4c5b-afb6-bc1f4e2f213f for instance 26d16c68-a04c-4a32-a599-e202e6c64152 on hv-cinder-80857 Nov 12 02:33:35.576829 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-1e2f30d3-aef2-455a-b24f-9440f0b08654 req-c36d46b8-5883-4339-bd72-a020290fccef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047344 Nov 12 02:33:35.577753 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 504/980] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:33:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:33:36.054271 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-eef11d2b-11d7-42e6-a061-46fec90cd92e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:36.055309 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-eef11d2b-11d7-42e6-a061-46fec90cd92e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:36.061633 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eef11d2b-11d7-42e6-a061-46fec90cd92e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:36.062178 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eef11d2b-11d7-42e6-a061-46fec90cd92e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:36.063278 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eef11d2b-11d7-42e6-a061-46fec90cd92e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:36.063785 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eef11d2b-11d7-42e6-a061-46fec90cd92e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:36.213621 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-eef11d2b-11d7-42e6-a061-46fec90cd92e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:36.221350 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-eef11d2b-11d7-42e6-a061-46fec90cd92e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1319 microversion: 2.1 time: 0.170694 Nov 12 02:33:36.221928 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 477/981] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:36 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:36.408394 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-11369b07-5347-4fe2-8a61-77a3e4a20222 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:36.409101 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-11369b07-5347-4fe2-8a61-77a3e4a20222 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:36.415592 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-11369b07-5347-4fe2-8a61-77a3e4a20222 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:36.416050 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-11369b07-5347-4fe2-8a61-77a3e4a20222 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:36.416848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-11369b07-5347-4fe2-8a61-77a3e4a20222 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:36.417469 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-11369b07-5347-4fe2-8a61-77a3e4a20222 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:36.432874 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-11369b07-5347-4fe2-8a61-77a3e4a20222 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] HTTP exception thrown: Instance 26d16c68-a04c-4a32-a599-e202e6c64152 could not be found. Nov 12 02:33:36.433472 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-11369b07-5347-4fe2-8a61-77a3e4a20222 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Returning 404 to user: Instance 26d16c68-a04c-4a32-a599-e202e6c64152 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:33:36.434317 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-11369b07-5347-4fe2-8a61-77a3e4a20222 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 404 len: 111 microversion: 2.20 time: 0.030134 Nov 12 02:33:36.435241 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 505/982] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:36 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 12 02:33:36.443956 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c5d5167f-8e31-49d7-bf3d-f6f4c2ac3559 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '.version_select at 0x7fc0646829d0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:36.467045 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c5d5167f-8e31-49d7-bf3d-f6f4c2ac3559 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-914282284" status: 204 len: 0 microversion: 2.20 time: 0.027287 Nov 12 02:33:36.467765 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 478/983] 10.222.0.70 () {60 vars in 1258 bytes} [Fri Nov 12 02:33:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-914282284 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 12 02:33:37.208720 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c82d0a7e-c2eb-4d10-96dd-1de60cc04568 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'create', calling method: .version_select at 0x7fc0645e2b80>, body: {"keypair": {"name": "tempest-keypair-2093012928"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:37.222908 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-c82d0a7e-c2eb-4d10-96dd-1de60cc04568 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Getting quotas for project 4e70a88f4b094066abaf2d0cd853f751. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:33:37.226559 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-c82d0a7e-c2eb-4d10-96dd-1de60cc04568 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Getting quotas for user eec0f3e481084226af3e4cb004585024 and project 4e70a88f4b094066abaf2d0cd853f751. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:33:37.238394 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e9e654ff-c7b6-4f86-9179-2b9e33322f43 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:37.239067 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e9e654ff-c7b6-4f86-9179-2b9e33322f43 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:37.245216 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e9e654ff-c7b6-4f86-9179-2b9e33322f43 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:37.245665 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e9e654ff-c7b6-4f86-9179-2b9e33322f43 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:37.246447 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e9e654ff-c7b6-4f86-9179-2b9e33322f43 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:37.246911 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e9e654ff-c7b6-4f86-9179-2b9e33322f43 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:37.409726 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e9e654ff-c7b6-4f86-9179-2b9e33322f43 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:37.418753 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e9e654ff-c7b6-4f86-9179-2b9e33322f43 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1319 microversion: 2.1 time: 0.184210 Nov 12 02:33:37.419348 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 479/984] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:37 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:33:37.425359 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-c82d0a7e-c2eb-4d10-96dd-1de60cc04568 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Getting quotas for project 4e70a88f4b094066abaf2d0cd853f751. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:33:37.439770 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-c82d0a7e-c2eb-4d10-96dd-1de60cc04568 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Getting quotas for user eec0f3e481084226af3e4cb004585024 and project 4e70a88f4b094066abaf2d0cd853f751. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:33:37.453068 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c82d0a7e-c2eb-4d10-96dd-1de60cc04568 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.248766 Nov 12 02:33:37.453893 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 506/985] 10.222.0.70 () {62 vars in 1198 bytes} [Fri Nov 12 02:33:37 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 250 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 12 02:33:38.435797 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a361d7e4-2011-4377-88cb-2401ca33b263 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:38.436360 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a361d7e4-2011-4377-88cb-2401ca33b263 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:38.442719 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a361d7e4-2011-4377-88cb-2401ca33b263 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:38.443098 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a361d7e4-2011-4377-88cb-2401ca33b263 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:38.443880 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a361d7e4-2011-4377-88cb-2401ca33b263 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:38.444312 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a361d7e4-2011-4377-88cb-2401ca33b263 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:38.582131 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a361d7e4-2011-4377-88cb-2401ca33b263 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:38.591792 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a361d7e4-2011-4377-88cb-2401ca33b263 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1319 microversion: 2.1 time: 0.159555 Nov 12 02:33:38.592418 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 480/986] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:38 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:38.765852 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-580451049", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed2ba848-d313-464e-93cb-db87f28d8bf9"}], "security_groups": [{"name": "tempest-securitygroup--471101189"}], "key_name": "tempest-keypair-2093012928", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:38.866975 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.network.neutron [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] validate_networks() for [('ed2ba848-d313-464e-93cb-db87f28d8bf9', None, None, None, None, None)] {{(pid=116099) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:33:39.250652 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Flavor limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:33:39.251125 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Image limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:33:39.251603 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Flavor pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:33:39.252569 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Image pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:33:39.252972 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:33:39.261914 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:39.262362 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:39.263201 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:39.263776 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:39.296816 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Getting quotas for project 4e70a88f4b094066abaf2d0cd853f751. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:33:39.300847 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Getting quotas for user eec0f3e481084226af3e4cb004585024 and project 4e70a88f4b094066abaf2d0cd853f751. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:33:39.311364 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Going to run 1 instances... {{(pid=116099) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:33:39.319666 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:33:39.368875 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b49fd96a-0047-4353-9713-896091cd512c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.608095 Nov 12 02:33:39.369507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 507/987] 10.222.0.70 () {62 vars in 1187 bytes} [Fri Nov 12 02:33:38 2021] POST /compute/v2.1/servers => generated 401 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 12 02:33:39.380662 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d6907801-5c3b-4cdd-bb28-9e5f361c391b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:39.381276 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d6907801-5c3b-4cdd-bb28-9e5f361c391b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:39.434877 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d6907801-5c3b-4cdd-bb28-9e5f361c391b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:39.443408 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d6907801-5c3b-4cdd-bb28-9e5f361c391b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:39.444921 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d6907801-5c3b-4cdd-bb28-9e5f361c391b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:39.446115 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d6907801-5c3b-4cdd-bb28-9e5f361c391b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1281 microversion: 2.20 time: 0.069952 Nov 12 02:33:39.446558 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 481/988] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:39 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:39.608925 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6e72bc11-f445-47a4-8667-39110ea35fc3 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:39.609573 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6e72bc11-f445-47a4-8667-39110ea35fc3 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:39.616600 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6e72bc11-f445-47a4-8667-39110ea35fc3 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:39.617051 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6e72bc11-f445-47a4-8667-39110ea35fc3 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:39.618066 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6e72bc11-f445-47a4-8667-39110ea35fc3 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:39.618555 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6e72bc11-f445-47a4-8667-39110ea35fc3 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:39.782498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6e72bc11-f445-47a4-8667-39110ea35fc3 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:39.792746 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6e72bc11-f445-47a4-8667-39110ea35fc3 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1319 microversion: 2.1 time: 0.187376 Nov 12 02:33:39.793853 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 508/989] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:39 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:40.463649 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-48bae785-d055-497b-91a6-f674e9869fc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:40.464177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-48bae785-d055-497b-91a6-f674e9869fc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:40.471841 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-48bae785-d055-497b-91a6-f674e9869fc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:40.472285 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-48bae785-d055-497b-91a6-f674e9869fc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:40.473064 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-48bae785-d055-497b-91a6-f674e9869fc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:40.473498 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-48bae785-d055-497b-91a6-f674e9869fc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:40.569677 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-48bae785-d055-497b-91a6-f674e9869fc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:40.579478 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-48bae785-d055-497b-91a6-f674e9869fc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:40.582188 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-48bae785-d055-497b-91a6-f674e9869fc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:40.583647 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-48bae785-d055-497b-91a6-f674e9869fc1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1341 microversion: 2.20 time: 0.123845 Nov 12 02:33:40.594188 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 482/990] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:40 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1341 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:40.810212 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-727220d2-c37d-48fa-8e8a-5027376c8ed6 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:40.810938 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-727220d2-c37d-48fa-8e8a-5027376c8ed6 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:40.818037 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-727220d2-c37d-48fa-8e8a-5027376c8ed6 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:40.818574 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-727220d2-c37d-48fa-8e8a-5027376c8ed6 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:40.819581 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-727220d2-c37d-48fa-8e8a-5027376c8ed6 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:40.820120 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-727220d2-c37d-48fa-8e8a-5027376c8ed6 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:41.029546 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-727220d2-c37d-48fa-8e8a-5027376c8ed6 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:41.037021 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-727220d2-c37d-48fa-8e8a-5027376c8ed6 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1319 microversion: 2.1 time: 0.230485 Nov 12 02:33:41.043615 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 509/991] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:40 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:41.364831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-2de531c9-44fe-4cb7-b589-860d8dc1c988 req-dabee3b9-d83f-4495-b393-8324b92398b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf3408b-498b-451e-8349-0c35db7b987f", "name": "network-vif-plugged", "status": "completed", "tag": "41c1bb20-7b8a-4b47-82ed-3a6b9d01e401"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:41.366515 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:33:41.366515 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:33:41.373844 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-2de531c9-44fe-4cb7-b589-860d8dc1c988 req-dabee3b9-d83f-4495-b393-8324b92398b3 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:41.374286 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-2de531c9-44fe-4cb7-b589-860d8dc1c988 req-dabee3b9-d83f-4495-b393-8324b92398b3 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:41.393047 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-2de531c9-44fe-4cb7-b589-860d8dc1c988 req-dabee3b9-d83f-4495-b393-8324b92398b3 service nova] Creating event network-vif-plugged:41c1bb20-7b8a-4b47-82ed-3a6b9d01e401 for instance 5cf3408b-498b-451e-8349-0c35db7b987f on hv-cinder-80857 Nov 12 02:33:41.399483 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-2de531c9-44fe-4cb7-b589-860d8dc1c988 req-dabee3b9-d83f-4495-b393-8324b92398b3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199235 Nov 12 02:33:41.400082 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 483/992] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:33:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:33:41.602025 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e31832cd-947a-445e-9c5b-b3296eb317c0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:41.603051 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e31832cd-947a-445e-9c5b-b3296eb317c0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:41.609271 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e31832cd-947a-445e-9c5b-b3296eb317c0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:41.609849 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e31832cd-947a-445e-9c5b-b3296eb317c0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:41.610892 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e31832cd-947a-445e-9c5b-b3296eb317c0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:41.612145 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e31832cd-947a-445e-9c5b-b3296eb317c0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:41.834178 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e31832cd-947a-445e-9c5b-b3296eb317c0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:41.844319 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e31832cd-947a-445e-9c5b-b3296eb317c0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:41.846816 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e31832cd-947a-445e-9c5b-b3296eb317c0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:41.848115 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e31832cd-947a-445e-9c5b-b3296eb317c0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1406 microversion: 2.20 time: 0.249867 Nov 12 02:33:41.848681 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 510/993] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:41 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:42.044230 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-72698c8b-0d66-43ba-91e2-b0e5b83c2b94 req-8460761c-d1d0-4584-9944-1f4f75f5ab0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75cfef8-bb7c-41d9-b969-d4f2454a64fd", "tag": "054e67ae-3cc3-4cc3-b945-349581ab03eb"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:42.046470 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:33:42.046470 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:33:42.055137 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-78f6119d-da7d-41ff-b9fc-1a1a96da268e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:42.058423 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-72698c8b-0d66-43ba-91e2-b0e5b83c2b94 req-8460761c-d1d0-4584-9944-1f4f75f5ab0f service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:42.061099 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-78f6119d-da7d-41ff-b9fc-1a1a96da268e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:42.062025 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-72698c8b-0d66-43ba-91e2-b0e5b83c2b94 req-8460761c-d1d0-4584-9944-1f4f75f5ab0f service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:42.072038 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-78f6119d-da7d-41ff-b9fc-1a1a96da268e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:42.072828 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-78f6119d-da7d-41ff-b9fc-1a1a96da268e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:42.073782 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-78f6119d-da7d-41ff-b9fc-1a1a96da268e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:42.074427 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-78f6119d-da7d-41ff-b9fc-1a1a96da268e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:42.083610 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-72698c8b-0d66-43ba-91e2-b0e5b83c2b94 req-8460761c-d1d0-4584-9944-1f4f75f5ab0f service nova] Creating event network-changed:054e67ae-3cc3-4cc3-b945-349581ab03eb for instance d75cfef8-bb7c-41d9-b969-d4f2454a64fd on hv-cinder-80857 Nov 12 02:33:42.088895 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-72698c8b-0d66-43ba-91e2-b0e5b83c2b94 req-8460761c-d1d0-4584-9944-1f4f75f5ab0f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050610 Nov 12 02:33:42.089833 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 484/994] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:33:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:33:42.239716 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-78f6119d-da7d-41ff-b9fc-1a1a96da268e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:42.247446 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-78f6119d-da7d-41ff-b9fc-1a1a96da268e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1319 microversion: 2.1 time: 0.196686 Nov 12 02:33:42.248016 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 511/995] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:42 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:42.866407 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b7906133-d182-4c2e-ac6f-072a65c6c134 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:42.867424 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b7906133-d182-4c2e-ac6f-072a65c6c134 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:42.873804 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7906133-d182-4c2e-ac6f-072a65c6c134 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:42.874279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7906133-d182-4c2e-ac6f-072a65c6c134 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:42.875106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7906133-d182-4c2e-ac6f-072a65c6c134 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:42.875543 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b7906133-d182-4c2e-ac6f-072a65c6c134 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:43.094610 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b7906133-d182-4c2e-ac6f-072a65c6c134 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:43.103210 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b7906133-d182-4c2e-ac6f-072a65c6c134 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:43.104698 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b7906133-d182-4c2e-ac6f-072a65c6c134 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:43.105807 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b7906133-d182-4c2e-ac6f-072a65c6c134 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1406 microversion: 2.20 time: 0.243547 Nov 12 02:33:43.106559 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 485/996] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:42 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:43.265027 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1f94a151-63d3-4d24-807a-3e40deee96bb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:43.265751 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1f94a151-63d3-4d24-807a-3e40deee96bb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:43.273084 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1f94a151-63d3-4d24-807a-3e40deee96bb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:43.273630 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1f94a151-63d3-4d24-807a-3e40deee96bb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:43.274429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1f94a151-63d3-4d24-807a-3e40deee96bb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:43.274913 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1f94a151-63d3-4d24-807a-3e40deee96bb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:43.531618 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1f94a151-63d3-4d24-807a-3e40deee96bb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:43.539769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1f94a151-63d3-4d24-807a-3e40deee96bb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1319 microversion: 2.1 time: 0.278541 Nov 12 02:33:43.540692 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 512/997] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:43 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:44.124312 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5a9b6a55-ba6f-4491-b783-73e13b013e06 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:44.124900 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5a9b6a55-ba6f-4491-b783-73e13b013e06 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:44.131831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a9b6a55-ba6f-4491-b783-73e13b013e06 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:44.132281 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a9b6a55-ba6f-4491-b783-73e13b013e06 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:44.133064 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a9b6a55-ba6f-4491-b783-73e13b013e06 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:44.133491 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a9b6a55-ba6f-4491-b783-73e13b013e06 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:44.266027 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5a9b6a55-ba6f-4491-b783-73e13b013e06 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:44.274199 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5a9b6a55-ba6f-4491-b783-73e13b013e06 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:44.275754 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5a9b6a55-ba6f-4491-b783-73e13b013e06 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:44.276850 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5a9b6a55-ba6f-4491-b783-73e13b013e06 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1406 microversion: 2.20 time: 0.156238 Nov 12 02:33:44.277405 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 486/998] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:44 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:44.555812 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a31146dc-61d2-40ec-9e4b-54adc907fc92 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:44.556341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a31146dc-61d2-40ec-9e4b-54adc907fc92 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:44.562883 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a31146dc-61d2-40ec-9e4b-54adc907fc92 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:44.563337 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a31146dc-61d2-40ec-9e4b-54adc907fc92 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:44.564120 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a31146dc-61d2-40ec-9e4b-54adc907fc92 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:44.565066 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a31146dc-61d2-40ec-9e4b-54adc907fc92 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:44.701891 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a31146dc-61d2-40ec-9e4b-54adc907fc92 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:44.709658 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a31146dc-61d2-40ec-9e4b-54adc907fc92 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1508 microversion: 2.1 time: 0.157572 Nov 12 02:33:44.710227 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 513/999] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:33:44 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:44.726381 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5a20913f-2ae9-464a-bda0-27b984261648 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0911c0d-964e-406b-92a6-ed775914c971", "device": "/dev/sdb"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:44.727971 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5a20913f-2ae9-464a-bda0-27b984261648 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:44.734056 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a20913f-2ae9-464a-bda0-27b984261648 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:44.734505 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a20913f-2ae9-464a-bda0-27b984261648 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:44.735333 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a20913f-2ae9-464a-bda0-27b984261648 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:44.735797 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a20913f-2ae9-464a-bda0-27b984261648 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:44.988576 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5a20913f-2ae9-464a-bda0-27b984261648 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "POST /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265800 Nov 12 02:33:44.992398 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 487/1000] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:33:44 2021] POST /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:33:45.295513 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-914b4212-8297-4a93-9d05-1d16e9011268 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:45.296118 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-914b4212-8297-4a93-9d05-1d16e9011268 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:45.302065 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-914b4212-8297-4a93-9d05-1d16e9011268 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:45.302513 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-914b4212-8297-4a93-9d05-1d16e9011268 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:45.303328 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-914b4212-8297-4a93-9d05-1d16e9011268 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:45.303761 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-914b4212-8297-4a93-9d05-1d16e9011268 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:45.437796 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-914b4212-8297-4a93-9d05-1d16e9011268 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:45.446218 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-914b4212-8297-4a93-9d05-1d16e9011268 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:45.447735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-914b4212-8297-4a93-9d05-1d16e9011268 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:45.448824 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-914b4212-8297-4a93-9d05-1d16e9011268 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1406 microversion: 2.20 time: 0.157064 Nov 12 02:33:45.449376 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 514/1001] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:45 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:46.468279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-eb5debfe-43dc-41bc-bc8a-615c8f888160 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:46.468962 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-eb5debfe-43dc-41bc-bc8a-615c8f888160 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:46.475680 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eb5debfe-43dc-41bc-bc8a-615c8f888160 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:46.476119 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eb5debfe-43dc-41bc-bc8a-615c8f888160 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:46.476876 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eb5debfe-43dc-41bc-bc8a-615c8f888160 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:46.477299 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eb5debfe-43dc-41bc-bc8a-615c8f888160 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:46.604812 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-eb5debfe-43dc-41bc-bc8a-615c8f888160 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:46.612552 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-eb5debfe-43dc-41bc-bc8a-615c8f888160 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:46.614036 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-eb5debfe-43dc-41bc-bc8a-615c8f888160 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:46.615150 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-eb5debfe-43dc-41bc-bc8a-615c8f888160 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1406 microversion: 2.20 time: 0.151458 Nov 12 02:33:46.615708 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 488/1002] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:46 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:47.633694 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b39c700e-4426-418f-a48b-0c919937c725 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:47.635056 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b39c700e-4426-418f-a48b-0c919937c725 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:47.643465 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b39c700e-4426-418f-a48b-0c919937c725 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:47.643911 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b39c700e-4426-418f-a48b-0c919937c725 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:47.644720 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b39c700e-4426-418f-a48b-0c919937c725 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:47.645153 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b39c700e-4426-418f-a48b-0c919937c725 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:47.777247 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b39c700e-4426-418f-a48b-0c919937c725 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:47.784902 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b39c700e-4426-418f-a48b-0c919937c725 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:47.786392 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b39c700e-4426-418f-a48b-0c919937c725 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:47.787554 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b39c700e-4426-418f-a48b-0c919937c725 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1406 microversion: 2.20 time: 0.157519 Nov 12 02:33:47.788108 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 515/1003] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:47 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:33:48.805527 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4525c0c8-5bff-4e30-bd63-085a27d3a08a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:48.806145 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4525c0c8-5bff-4e30-bd63-085a27d3a08a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:48.812711 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4525c0c8-5bff-4e30-bd63-085a27d3a08a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:48.813164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4525c0c8-5bff-4e30-bd63-085a27d3a08a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:48.813952 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4525c0c8-5bff-4e30-bd63-085a27d3a08a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:48.814924 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4525c0c8-5bff-4e30-bd63-085a27d3a08a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:48.959817 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4525c0c8-5bff-4e30-bd63-085a27d3a08a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:48.967883 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4525c0c8-5bff-4e30-bd63-085a27d3a08a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:48.969394 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4525c0c8-5bff-4e30-bd63-085a27d3a08a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:48.970505 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4525c0c8-5bff-4e30-bd63-085a27d3a08a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1406 microversion: 2.20 time: 0.168842 Nov 12 02:33:48.971132 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 489/1004] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:48 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:49.235727 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-61f5ac97-fb38-4edc-a240-cb26bb40c47f req-f14c5d84-6503-4980-9741-a50d70fda77e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75cfef8-bb7c-41d9-b969-d4f2454a64fd", "name": "network-vif-plugged", "status": "completed", "tag": "054e67ae-3cc3-4cc3-b945-349581ab03eb"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:49.238101 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:33:49.238101 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:33:49.246333 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-61f5ac97-fb38-4edc-a240-cb26bb40c47f req-f14c5d84-6503-4980-9741-a50d70fda77e service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:49.246989 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-61f5ac97-fb38-4edc-a240-cb26bb40c47f req-f14c5d84-6503-4980-9741-a50d70fda77e service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:49.259246 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-61f5ac97-fb38-4edc-a240-cb26bb40c47f req-f14c5d84-6503-4980-9741-a50d70fda77e service nova] Creating event network-vif-plugged:054e67ae-3cc3-4cc3-b945-349581ab03eb for instance d75cfef8-bb7c-41d9-b969-d4f2454a64fd on hv-cinder-80857 Nov 12 02:33:49.264173 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-61f5ac97-fb38-4edc-a240-cb26bb40c47f req-f14c5d84-6503-4980-9741-a50d70fda77e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032243 Nov 12 02:33:49.264759 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 516/1005] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:33:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:33:49.988892 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7fabad41-771d-4c9a-b7d9-1bd8dc3a5b63 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:49.989422 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7fabad41-771d-4c9a-b7d9-1bd8dc3a5b63 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:49.996133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7fabad41-771d-4c9a-b7d9-1bd8dc3a5b63 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:49.996589 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7fabad41-771d-4c9a-b7d9-1bd8dc3a5b63 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:49.997377 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7fabad41-771d-4c9a-b7d9-1bd8dc3a5b63 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:49.997816 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7fabad41-771d-4c9a-b7d9-1bd8dc3a5b63 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:50.145462 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7fabad41-771d-4c9a-b7d9-1bd8dc3a5b63 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:50.153964 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7fabad41-771d-4c9a-b7d9-1bd8dc3a5b63 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:50.156010 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7fabad41-771d-4c9a-b7d9-1bd8dc3a5b63 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:50.156962 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7fabad41-771d-4c9a-b7d9-1bd8dc3a5b63 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1406 microversion: 2.20 time: 0.171895 Nov 12 02:33:50.157516 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 490/1006] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:49 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:51.177821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8c213720-f21e-49d9-8bc4-1034e1e9cd7e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:51.178513 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8c213720-f21e-49d9-8bc4-1034e1e9cd7e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:51.184877 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8c213720-f21e-49d9-8bc4-1034e1e9cd7e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:51.185282 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8c213720-f21e-49d9-8bc4-1034e1e9cd7e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:51.186061 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8c213720-f21e-49d9-8bc4-1034e1e9cd7e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:51.186493 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8c213720-f21e-49d9-8bc4-1034e1e9cd7e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:51.317122 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8c213720-f21e-49d9-8bc4-1034e1e9cd7e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:51.324892 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8c213720-f21e-49d9-8bc4-1034e1e9cd7e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:51.326532 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8c213720-f21e-49d9-8bc4-1034e1e9cd7e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:51.327561 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8c213720-f21e-49d9-8bc4-1034e1e9cd7e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1406 microversion: 2.20 time: 0.155023 Nov 12 02:33:51.328122 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 517/1007] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:51 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:52.346164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7423e3b3-8458-4b4d-a09d-1945f890af75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:52.346810 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7423e3b3-8458-4b4d-a09d-1945f890af75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:52.353505 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7423e3b3-8458-4b4d-a09d-1945f890af75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:52.353941 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7423e3b3-8458-4b4d-a09d-1945f890af75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:52.354739 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7423e3b3-8458-4b4d-a09d-1945f890af75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:52.355179 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7423e3b3-8458-4b4d-a09d-1945f890af75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:52.501027 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7423e3b3-8458-4b4d-a09d-1945f890af75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:52.509336 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7423e3b3-8458-4b4d-a09d-1945f890af75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:52.510865 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7423e3b3-8458-4b4d-a09d-1945f890af75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:33:52.512021 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7423e3b3-8458-4b4d-a09d-1945f890af75 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1598 microversion: 2.20 time: 0.170062 Nov 12 02:33:52.512576 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 491/1008] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:33:52 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:33:52.534658 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0070d544-3c7a-46eb-9c05-aa74c3dc19a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:33:52.535796 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0070d544-3c7a-46eb-9c05-aa74c3dc19a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:52.541901 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0070d544-3c7a-46eb-9c05-aa74c3dc19a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:52.542345 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0070d544-3c7a-46eb-9c05-aa74c3dc19a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:52.544078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0070d544-3c7a-46eb-9c05-aa74c3dc19a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:52.544636 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0070d544-3c7a-46eb-9c05-aa74c3dc19a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:52.632549 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0070d544-3c7a-46eb-9c05-aa74c3dc19a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102772 Nov 12 02:33:52.633174 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 518/1009] 10.222.0.70 () {60 vars in 1315 bytes} [Fri Nov 12 02:33:52 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:33:53.625781 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-039b4cb6-29e2-47bf-973b-139edcb60e2c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:53.626605 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-039b4cb6-29e2-47bf-973b-139edcb60e2c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:53.627347 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-b6b5d3e6-415f-4d0c-928d-4c0867d511e2 req-744ea4ca-1b88-4bba-ab47-15261e4cc193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75cfef8-bb7c-41d9-b969-d4f2454a64fd", "tag": "054e67ae-3cc3-4cc3-b945-349581ab03eb"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:53.629970 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:33:53.629970 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:33:53.633581 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-039b4cb6-29e2-47bf-973b-139edcb60e2c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:53.634049 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-039b4cb6-29e2-47bf-973b-139edcb60e2c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:53.634906 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-039b4cb6-29e2-47bf-973b-139edcb60e2c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:53.635340 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-039b4cb6-29e2-47bf-973b-139edcb60e2c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:53.636710 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-b6b5d3e6-415f-4d0c-928d-4c0867d511e2 req-744ea4ca-1b88-4bba-ab47-15261e4cc193 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:53.637167 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-b6b5d3e6-415f-4d0c-928d-4c0867d511e2 req-744ea4ca-1b88-4bba-ab47-15261e4cc193 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:53.649194 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-b6b5d3e6-415f-4d0c-928d-4c0867d511e2 req-744ea4ca-1b88-4bba-ab47-15261e4cc193 service nova] Creating event network-changed:054e67ae-3cc3-4cc3-b945-349581ab03eb for instance d75cfef8-bb7c-41d9-b969-d4f2454a64fd on hv-cinder-80857 Nov 12 02:33:53.655303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-b6b5d3e6-415f-4d0c-928d-4c0867d511e2 req-744ea4ca-1b88-4bba-ab47-15261e4cc193 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031783 Nov 12 02:33:53.656275 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 519/1010] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:33:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:33:57.839297 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-039b4cb6-29e2-47bf-973b-139edcb60e2c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 14 microversion: 2.20 time: 4.217400 Nov 12 02:33:57.839963 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 492/1011] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:33:53 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 14 bytes in 4219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:33:58.853674 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-852d7242-cd73-4af0-bedc-263de7aff56d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:58.855628 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-852d7242-cd73-4af0-bedc-263de7aff56d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:58.863489 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-852d7242-cd73-4af0-bedc-263de7aff56d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:58.863931 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-852d7242-cd73-4af0-bedc-263de7aff56d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:58.864703 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-852d7242-cd73-4af0-bedc-263de7aff56d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:58.865276 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-852d7242-cd73-4af0-bedc-263de7aff56d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:58.964495 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-852d7242-cd73-4af0-bedc-263de7aff56d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 14 microversion: 2.20 time: 0.117976 Nov 12 02:33:58.965141 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 520/1012] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:33:58 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:33:59.975655 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cea5cf7a-431b-4897-8b17-f0026ee81292 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:33:59.976659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cea5cf7a-431b-4897-8b17-f0026ee81292 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:33:59.983554 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cea5cf7a-431b-4897-8b17-f0026ee81292 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:59.984004 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cea5cf7a-431b-4897-8b17-f0026ee81292 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:33:59.984775 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cea5cf7a-431b-4897-8b17-f0026ee81292 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:33:59.985207 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cea5cf7a-431b-4897-8b17-f0026ee81292 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:03.319373 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cea5cf7a-431b-4897-8b17-f0026ee81292 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 14 microversion: 2.20 time: 3.347082 Nov 12 02:34:03.320268 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 493/1013] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:33:59 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 14 bytes in 3349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:04.331755 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3e5b2759-32ff-41c4-b3ce-f96e691b32c9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:04.332656 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3e5b2759-32ff-41c4-b3ce-f96e691b32c9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:04.339962 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3e5b2759-32ff-41c4-b3ce-f96e691b32c9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:04.340771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3e5b2759-32ff-41c4-b3ce-f96e691b32c9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:04.341202 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3e5b2759-32ff-41c4-b3ce-f96e691b32c9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:04.341720 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3e5b2759-32ff-41c4-b3ce-f96e691b32c9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:04.443147 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3e5b2759-32ff-41c4-b3ce-f96e691b32c9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 14 microversion: 2.20 time: 0.115493 Nov 12 02:34:04.443792 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 521/1014] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:04 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:05.461772 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ca914e11-c015-49fe-90b1-0373ed25f019 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:05.462810 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ca914e11-c015-49fe-90b1-0373ed25f019 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:05.470521 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca914e11-c015-49fe-90b1-0373ed25f019 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:05.471224 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca914e11-c015-49fe-90b1-0373ed25f019 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:05.472463 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca914e11-c015-49fe-90b1-0373ed25f019 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:05.472946 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca914e11-c015-49fe-90b1-0373ed25f019 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:05.607826 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ca914e11-c015-49fe-90b1-0373ed25f019 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 6520 microversion: 2.20 time: 0.156343 Nov 12 02:34:05.608603 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 494/1015] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:05 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 6520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:34:06.619934 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c3351640-ba7e-4431-85b6-baf274ec20db tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:06.620931 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c3351640-ba7e-4431-85b6-baf274ec20db tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:06.627948 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c3351640-ba7e-4431-85b6-baf274ec20db tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:06.628395 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c3351640-ba7e-4431-85b6-baf274ec20db tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:06.629174 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c3351640-ba7e-4431-85b6-baf274ec20db tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:06.629601 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c3351640-ba7e-4431-85b6-baf274ec20db tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:06.736205 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c3351640-ba7e-4431-85b6-baf274ec20db tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 15025 microversion: 2.20 time: 0.121099 Nov 12 02:34:06.736888 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 522/1016] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:06 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 15025 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:07.749675 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fd2447d4-e921-45cb-b113-5695f90c04d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:07.750729 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fd2447d4-e921-45cb-b113-5695f90c04d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:07.758042 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fd2447d4-e921-45cb-b113-5695f90c04d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:07.758511 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fd2447d4-e921-45cb-b113-5695f90c04d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:07.759389 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fd2447d4-e921-45cb-b113-5695f90c04d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:07.759856 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fd2447d4-e921-45cb-b113-5695f90c04d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:07.861430 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fd2447d4-e921-45cb-b113-5695f90c04d9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 18083 microversion: 2.20 time: 0.115913 Nov 12 02:34:07.862366 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 495/1017] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:07 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 18083 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:08.422112 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fcb60f64-940d-4d4c-840b-c156b8a3ab32 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:08.422881 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-fcb60f64-940d-4d4c-840b-c156b8a3ab32 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:08.430198 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fcb60f64-940d-4d4c-840b-c156b8a3ab32 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:08.430651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fcb60f64-940d-4d4c-840b-c156b8a3ab32 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:08.431472 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fcb60f64-940d-4d4c-840b-c156b8a3ab32 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:08.431907 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fcb60f64-940d-4d4c-840b-c156b8a3ab32 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:08.525639 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-fcb60f64-940d-4d4c-840b-c156b8a3ab32 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lazy-loading 'services' on Instance uuid 5cf3408b-498b-451e-8349-0c35db7b987f {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:34:08.603821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-fcb60f64-940d-4d4c-840b-c156b8a3ab32 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f/os-volume_attachments/a0911c0d-964e-406b-92a6-ed775914c971" status: 202 len: 0 microversion: 2.1 time: 0.185813 Nov 12 02:34:08.604681 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 523/1018] 10.222.0.70 () {58 vars in 1415 bytes} [Fri Nov 12 02:34:08 2021] DELETE /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f/os-volume_attachments/a0911c0d-964e-406b-92a6-ed775914c971 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:34:08.873977 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8d881347-4fa4-4642-924f-6e1ee7eb6389 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:08.875233 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8d881347-4fa4-4642-924f-6e1ee7eb6389 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:08.883842 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8d881347-4fa4-4642-924f-6e1ee7eb6389 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:08.883842 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8d881347-4fa4-4642-924f-6e1ee7eb6389 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:08.884624 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8d881347-4fa4-4642-924f-6e1ee7eb6389 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:08.885191 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8d881347-4fa4-4642-924f-6e1ee7eb6389 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:09.003291 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8d881347-4fa4-4642-924f-6e1ee7eb6389 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 19342 microversion: 2.20 time: 0.133096 Nov 12 02:34:09.003833 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 496/1019] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:08 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 19342 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:09.730482 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b78cfb0d-684f-48f2-8257-bffa47c3d358 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:09.731100 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b78cfb0d-684f-48f2-8257-bffa47c3d358 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:09.737494 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b78cfb0d-684f-48f2-8257-bffa47c3d358 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:09.737956 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b78cfb0d-684f-48f2-8257-bffa47c3d358 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:09.738775 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b78cfb0d-684f-48f2-8257-bffa47c3d358 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:09.739217 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b78cfb0d-684f-48f2-8257-bffa47c3d358 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:09.765292 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b78cfb0d-684f-48f2-8257-bffa47c3d358 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Going to try to terminate instance {{(pid=116099) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:34:09.855871 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b78cfb0d-684f-48f2-8257-bffa47c3d358 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 204 len: 0 microversion: 2.1 time: 0.129217 Nov 12 02:34:09.856934 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 524/1020] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:34:09 2021] DELETE /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:34:09.866791 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7b2aa023-4acf-44d8-a221-6a76694011ca tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:09.867766 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7b2aa023-4acf-44d8-a221-6a76694011ca tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:09.875465 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7b2aa023-4acf-44d8-a221-6a76694011ca tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:09.876148 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7b2aa023-4acf-44d8-a221-6a76694011ca tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:09.876715 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7b2aa023-4acf-44d8-a221-6a76694011ca tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:09.877152 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7b2aa023-4acf-44d8-a221-6a76694011ca tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:10.015264 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4eeccb89-42db-4dad-b4db-dcb0e3a1ac66 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:10.016321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4eeccb89-42db-4dad-b4db-dcb0e3a1ac66 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:10.022555 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4eeccb89-42db-4dad-b4db-dcb0e3a1ac66 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:10.023615 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4eeccb89-42db-4dad-b4db-dcb0e3a1ac66 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:10.024397 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4eeccb89-42db-4dad-b4db-dcb0e3a1ac66 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:10.024826 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4eeccb89-42db-4dad-b4db-dcb0e3a1ac66 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:10.031542 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7b2aa023-4acf-44d8-a221-6a76694011ca tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:10.039148 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7b2aa023-4acf-44d8-a221-6a76694011ca tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1514 microversion: 2.1 time: 0.176536 Nov 12 02:34:10.039725 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 497/1021] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:09 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:10.152296 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4eeccb89-42db-4dad-b4db-dcb0e3a1ac66 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 21338 microversion: 2.20 time: 0.140492 Nov 12 02:34:10.153589 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 525/1022] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:10 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 21338 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:34:11.056561 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b33e784c-a548-48fa-a5db-f99a74f6c103 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:11.057168 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b33e784c-a548-48fa-a5db-f99a74f6c103 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:11.063472 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b33e784c-a548-48fa-a5db-f99a74f6c103 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:11.063914 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b33e784c-a548-48fa-a5db-f99a74f6c103 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:11.064684 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b33e784c-a548-48fa-a5db-f99a74f6c103 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:11.065118 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b33e784c-a548-48fa-a5db-f99a74f6c103 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:11.165312 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-42256d75-5027-4236-a8f1-8318217e9b1b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:11.166317 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-42256d75-5027-4236-a8f1-8318217e9b1b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:11.173622 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42256d75-5027-4236-a8f1-8318217e9b1b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:11.174248 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42256d75-5027-4236-a8f1-8318217e9b1b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:11.174906 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42256d75-5027-4236-a8f1-8318217e9b1b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:11.175344 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42256d75-5027-4236-a8f1-8318217e9b1b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:11.216097 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b33e784c-a548-48fa-a5db-f99a74f6c103 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:11.223791 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b33e784c-a548-48fa-a5db-f99a74f6c103 tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1514 microversion: 2.1 time: 0.171291 Nov 12 02:34:11.224401 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 498/1023] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:11 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:11.284083 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-42256d75-5027-4236-a8f1-8318217e9b1b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 22836 microversion: 2.20 time: 0.123123 Nov 12 02:34:11.284731 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 526/1024] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:11 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 22836 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:34:12.241216 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8272c419-ee77-44ea-8c23-2441667156eb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:12.242713 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8272c419-ee77-44ea-8c23-2441667156eb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:12.250324 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8272c419-ee77-44ea-8c23-2441667156eb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:12.250862 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8272c419-ee77-44ea-8c23-2441667156eb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:12.251681 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8272c419-ee77-44ea-8c23-2441667156eb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:12.252210 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8272c419-ee77-44ea-8c23-2441667156eb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:12.296357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1248f34d-d3d6-4223-b7ed-b5c94fb4a1d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:12.297384 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1248f34d-d3d6-4223-b7ed-b5c94fb4a1d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:12.304563 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1248f34d-d3d6-4223-b7ed-b5c94fb4a1d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:12.305009 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1248f34d-d3d6-4223-b7ed-b5c94fb4a1d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:12.305806 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1248f34d-d3d6-4223-b7ed-b5c94fb4a1d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:12.306236 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1248f34d-d3d6-4223-b7ed-b5c94fb4a1d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:12.397308 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8272c419-ee77-44ea-8c23-2441667156eb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:12.406841 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8272c419-ee77-44ea-8c23-2441667156eb tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1514 microversion: 2.1 time: 0.169146 Nov 12 02:34:12.407433 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 499/1025] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:12 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:12.431372 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1248f34d-d3d6-4223-b7ed-b5c94fb4a1d7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 23793 microversion: 2.20 time: 0.138860 Nov 12 02:34:12.432025 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 527/1026] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:12 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 23793 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:34:13.304700 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-6679f311-90b0-417e-adf8-2107aad21f24 req-4d067474-9a10-46f7-8fb7-c81eb703e789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf3408b-498b-451e-8349-0c35db7b987f", "name": "network-vif-deleted", "tag": "41c1bb20-7b8a-4b47-82ed-3a6b9d01e401"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:13.306700 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:34:13.306700 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:34:13.314384 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-6679f311-90b0-417e-adf8-2107aad21f24 req-4d067474-9a10-46f7-8fb7-c81eb703e789 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:13.314853 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-6679f311-90b0-417e-adf8-2107aad21f24 req-4d067474-9a10-46f7-8fb7-c81eb703e789 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:13.327010 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-6679f311-90b0-417e-adf8-2107aad21f24 req-4d067474-9a10-46f7-8fb7-c81eb703e789 service nova] Creating event network-vif-deleted:41c1bb20-7b8a-4b47-82ed-3a6b9d01e401 for instance 5cf3408b-498b-451e-8349-0c35db7b987f on hv-cinder-80857 Nov 12 02:34:13.332564 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-6679f311-90b0-417e-adf8-2107aad21f24 req-4d067474-9a10-46f7-8fb7-c81eb703e789 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032731 Nov 12 02:34:13.333152 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 500/1027] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:34:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:34:13.425382 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-11bec726-3dcf-4290-87e0-8c2f977f23db tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:13.426002 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-11bec726-3dcf-4290-87e0-8c2f977f23db tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:13.433347 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-11bec726-3dcf-4290-87e0-8c2f977f23db tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:13.433806 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-11bec726-3dcf-4290-87e0-8c2f977f23db tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:13.434732 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-11bec726-3dcf-4290-87e0-8c2f977f23db tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:13.435174 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-11bec726-3dcf-4290-87e0-8c2f977f23db tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:13.443524 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dc71e59f-9013-4096-b28b-6619180415f8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:13.445569 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dc71e59f-9013-4096-b28b-6619180415f8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:13.452670 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc71e59f-9013-4096-b28b-6619180415f8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:13.453140 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc71e59f-9013-4096-b28b-6619180415f8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:13.453936 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc71e59f-9013-4096-b28b-6619180415f8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:13.454383 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dc71e59f-9013-4096-b28b-6619180415f8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:13.504755 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-11bec726-3dcf-4290-87e0-8c2f977f23db tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58af07ec5a0c408faf8ccd6c7e9c0a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a03794071c7f41db801753ddab2f9971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:13.513813 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-11bec726-3dcf-4290-87e0-8c2f977f23db tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 200 len: 1304 microversion: 2.1 time: 0.092536 Nov 12 02:34:13.514414 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 528/1028] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:13 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:13.592553 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dc71e59f-9013-4096-b28b-6619180415f8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 24929 microversion: 2.20 time: 0.152855 Nov 12 02:34:13.593197 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 501/1029] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:13 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 24929 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:34:14.532677 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-dfeae72f-c650-4545-9db9-f013f9741c9e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:14.533335 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-dfeae72f-c650-4545-9db9-f013f9741c9e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] [instance: 5cf3408b-498b-451e-8349-0c35db7b987f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:14.540009 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dfeae72f-c650-4545-9db9-f013f9741c9e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:14.540456 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dfeae72f-c650-4545-9db9-f013f9741c9e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:14.541258 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dfeae72f-c650-4545-9db9-f013f9741c9e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:14.541694 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dfeae72f-c650-4545-9db9-f013f9741c9e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:14.556654 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-dfeae72f-c650-4545-9db9-f013f9741c9e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] HTTP exception thrown: Instance 5cf3408b-498b-451e-8349-0c35db7b987f could not be found. Nov 12 02:34:14.557258 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-dfeae72f-c650-4545-9db9-f013f9741c9e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] Returning 404 to user: Instance 5cf3408b-498b-451e-8349-0c35db7b987f could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:34:14.558106 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-dfeae72f-c650-4545-9db9-f013f9741c9e tempest-VolumesSnapshotTestJSON-1213589880 tempest-VolumesSnapshotTestJSON-1213589880-project] 10.222.0.70 "GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f" status: 404 len: 111 microversion: 2.1 time: 0.029367 Nov 12 02:34:14.558699 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 529/1030] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:14 2021] GET /compute/v2.1/servers/5cf3408b-498b-451e-8349-0c35db7b987f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:34:14.605865 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2f7d4509-36fe-41be-bd24-6a2c3c41ccd3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:14.606918 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2f7d4509-36fe-41be-bd24-6a2c3c41ccd3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:14.613745 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f7d4509-36fe-41be-bd24-6a2c3c41ccd3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:14.614194 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f7d4509-36fe-41be-bd24-6a2c3c41ccd3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:14.615036 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f7d4509-36fe-41be-bd24-6a2c3c41ccd3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:14.615481 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f7d4509-36fe-41be-bd24-6a2c3c41ccd3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:14.724967 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2f7d4509-36fe-41be-bd24-6a2c3c41ccd3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 25990 microversion: 2.20 time: 0.123513 Nov 12 02:34:14.726050 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 502/1031] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:14 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 25990 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:15.739364 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-13752234-b5c9-4231-8956-44f8686088b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:15.740279 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-13752234-b5c9-4231-8956-44f8686088b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:15.747632 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-13752234-b5c9-4231-8956-44f8686088b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:15.748084 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-13752234-b5c9-4231-8956-44f8686088b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:15.748872 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-13752234-b5c9-4231-8956-44f8686088b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:15.749321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-13752234-b5c9-4231-8956-44f8686088b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:15.860591 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-13752234-b5c9-4231-8956-44f8686088b9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 26993 microversion: 2.20 time: 0.124738 Nov 12 02:34:15.861588 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 530/1032] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:15 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 26993 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:16.873879 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cfb75fcd-08c9-4e13-bbb2-2a52e2409294 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:16.874926 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cfb75fcd-08c9-4e13-bbb2-2a52e2409294 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:16.882050 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cfb75fcd-08c9-4e13-bbb2-2a52e2409294 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:16.882546 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cfb75fcd-08c9-4e13-bbb2-2a52e2409294 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:16.883387 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cfb75fcd-08c9-4e13-bbb2-2a52e2409294 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:16.883821 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cfb75fcd-08c9-4e13-bbb2-2a52e2409294 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:20.231664 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cfb75fcd-08c9-4e13-bbb2-2a52e2409294 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 27813 microversion: 2.20 time: 3.361940 Nov 12 02:34:20.232360 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 503/1033] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:16 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 27813 bytes in 3364 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:20.466482 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0300e16b-687b-4383-9576-dbcadc39d679 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:20.467501 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0300e16b-687b-4383-9576-dbcadc39d679 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:20.475000 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0300e16b-687b-4383-9576-dbcadc39d679 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:20.475469 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0300e16b-687b-4383-9576-dbcadc39d679 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:20.476730 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0300e16b-687b-4383-9576-dbcadc39d679 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:20.477159 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0300e16b-687b-4383-9576-dbcadc39d679 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:20.509666 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0300e16b-687b-4383-9576-dbcadc39d679 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047430 Nov 12 02:34:20.510220 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 531/1034] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:34:20 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:34:20.567311 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-14245d9f-5089-45b0-b2a7-ba9fc5efbb39 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:20.567897 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-14245d9f-5089-45b0-b2a7-ba9fc5efbb39 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:20.575656 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14245d9f-5089-45b0-b2a7-ba9fc5efbb39 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:20.576111 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14245d9f-5089-45b0-b2a7-ba9fc5efbb39 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:20.576906 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14245d9f-5089-45b0-b2a7-ba9fc5efbb39 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:20.577365 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14245d9f-5089-45b0-b2a7-ba9fc5efbb39 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:20.604654 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-14245d9f-5089-45b0-b2a7-ba9fc5efbb39 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:34:20.682266 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-14245d9f-5089-45b0-b2a7-ba9fc5efbb39 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 204 len: 0 microversion: 2.1 time: 0.118513 Nov 12 02:34:20.682888 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 504/1035] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:34:20 2021] DELETE /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:34:20.691034 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a55e9a0a-9041-44a7-8b6e-29e24d22701d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:20.691651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a55e9a0a-9041-44a7-8b6e-29e24d22701d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:20.698208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a55e9a0a-9041-44a7-8b6e-29e24d22701d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:20.698372 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a55e9a0a-9041-44a7-8b6e-29e24d22701d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:20.699170 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a55e9a0a-9041-44a7-8b6e-29e24d22701d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:20.699601 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a55e9a0a-9041-44a7-8b6e-29e24d22701d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:20.835300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a55e9a0a-9041-44a7-8b6e-29e24d22701d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:20.842887 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a55e9a0a-9041-44a7-8b6e-29e24d22701d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1670 microversion: 2.1 time: 0.155644 Nov 12 02:34:20.843462 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 532/1036] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:20 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:21.244823 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7377f098-d56c-4c37-99ee-308637cc19b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:21.245833 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7377f098-d56c-4c37-99ee-308637cc19b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:21.252075 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7377f098-d56c-4c37-99ee-308637cc19b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:21.252526 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7377f098-d56c-4c37-99ee-308637cc19b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:21.253313 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7377f098-d56c-4c37-99ee-308637cc19b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:21.253748 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7377f098-d56c-4c37-99ee-308637cc19b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:21.348743 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7377f098-d56c-4c37-99ee-308637cc19b6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 27813 microversion: 2.20 time: 0.108551 Nov 12 02:34:21.349507 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 505/1037] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:21 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 27813 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:21.860571 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-50784d85-61da-438f-b919-d400e7f68138 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:21.861186 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-50784d85-61da-438f-b919-d400e7f68138 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:21.867811 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-50784d85-61da-438f-b919-d400e7f68138 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:21.868271 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-50784d85-61da-438f-b919-d400e7f68138 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:21.869040 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-50784d85-61da-438f-b919-d400e7f68138 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:21.869474 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-50784d85-61da-438f-b919-d400e7f68138 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:22.065613 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-50784d85-61da-438f-b919-d400e7f68138 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:22.073973 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-50784d85-61da-438f-b919-d400e7f68138 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1670 microversion: 2.1 time: 0.217540 Nov 12 02:34:22.074571 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 533/1038] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:21 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1670 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:22.364419 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d22fe14e-8af3-4380-b194-db155bffa379 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:22.365434 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d22fe14e-8af3-4380-b194-db155bffa379 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:22.374135 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d22fe14e-8af3-4380-b194-db155bffa379 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:22.374588 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d22fe14e-8af3-4380-b194-db155bffa379 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:22.375425 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d22fe14e-8af3-4380-b194-db155bffa379 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:22.375882 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d22fe14e-8af3-4380-b194-db155bffa379 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:22.570041 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d22fe14e-8af3-4380-b194-db155bffa379 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 27991 microversion: 2.20 time: 0.210202 Nov 12 02:34:22.571014 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 506/1039] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:22 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 27991 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:23.091636 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-89d4c892-12b1-485c-933e-9f14c7fba00b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:23.092375 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-89d4c892-12b1-485c-933e-9f14c7fba00b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:23.098417 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-89d4c892-12b1-485c-933e-9f14c7fba00b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:23.100364 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-89d4c892-12b1-485c-933e-9f14c7fba00b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:23.101668 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-89d4c892-12b1-485c-933e-9f14c7fba00b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:23.102113 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-89d4c892-12b1-485c-933e-9f14c7fba00b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:23.187061 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-89d4c892-12b1-485c-933e-9f14c7fba00b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:23.195202 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-89d4c892-12b1-485c-933e-9f14c7fba00b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1603 microversion: 2.1 time: 0.107558 Nov 12 02:34:23.195762 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 534/1040] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:23 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1603 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:34:23.582447 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b2c98abd-1c15-41e4-834a-7eb535452663 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:23.583651 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b2c98abd-1c15-41e4-834a-7eb535452663 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:23.591720 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b2c98abd-1c15-41e4-834a-7eb535452663 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:23.592175 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b2c98abd-1c15-41e4-834a-7eb535452663 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:23.592971 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b2c98abd-1c15-41e4-834a-7eb535452663 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:23.593585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b2c98abd-1c15-41e4-834a-7eb535452663 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:23.703335 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b2c98abd-1c15-41e4-834a-7eb535452663 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.122703 Nov 12 02:34:23.703335 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 507/1041] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:23 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:23.732807 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-64b4498c-b760-4487-a844-583cd6e01e9b req-365bfea3-6004-4f7a-82e5-e4d845576cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1ce3bd-1739-49be-ab2e-e81c1026ae30", "name": "network-vif-deleted", "tag": "2c2246ad-0135-4e41-9bee-c87015e386f7"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:23.735015 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:34:23.735015 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:34:23.744997 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-64b4498c-b760-4487-a844-583cd6e01e9b req-365bfea3-6004-4f7a-82e5-e4d845576cf9 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:23.745433 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-64b4498c-b760-4487-a844-583cd6e01e9b req-365bfea3-6004-4f7a-82e5-e4d845576cf9 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:23.759304 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-64b4498c-b760-4487-a844-583cd6e01e9b req-365bfea3-6004-4f7a-82e5-e4d845576cf9 service nova] Creating event network-vif-deleted:2c2246ad-0135-4e41-9bee-c87015e386f7 for instance 5c1ce3bd-1739-49be-ab2e-e81c1026ae30 on hv-cinder-80857 Nov 12 02:34:23.767371 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-64b4498c-b760-4487-a844-583cd6e01e9b req-365bfea3-6004-4f7a-82e5-e4d845576cf9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038391 Nov 12 02:34:23.768225 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 535/1042] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:34:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:34:24.214154 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-73c43cab-884c-41c3-be78-962728ee257e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:24.214888 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-73c43cab-884c-41c3-be78-962728ee257e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:24.221646 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73c43cab-884c-41c3-be78-962728ee257e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:24.222098 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73c43cab-884c-41c3-be78-962728ee257e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:24.222911 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73c43cab-884c-41c3-be78-962728ee257e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:24.223348 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73c43cab-884c-41c3-be78-962728ee257e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:24.258359 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73c43cab-884c-41c3-be78-962728ee257e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:24.258847 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-73c43cab-884c-41c3-be78-962728ee257e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:24.259313 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-73c43cab-884c-41c3-be78-962728ee257e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lazy-loading 'fault' on Instance uuid 5c1ce3bd-1739-49be-ab2e-e81c1026ae30 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:34:24.309528 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-73c43cab-884c-41c3-be78-962728ee257e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:24.316841 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-73c43cab-884c-41c3-be78-962728ee257e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 200 len: 1325 microversion: 2.1 time: 0.106840 Nov 12 02:34:24.317737 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 508/1043] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:24 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 1325 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:24.714104 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c0701121-d35b-4a8c-9c5e-be37dd688e03 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:24.715245 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c0701121-d35b-4a8c-9c5e-be37dd688e03 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:24.721821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c0701121-d35b-4a8c-9c5e-be37dd688e03 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:24.722346 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c0701121-d35b-4a8c-9c5e-be37dd688e03 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:24.723169 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c0701121-d35b-4a8c-9c5e-be37dd688e03 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:24.724345 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c0701121-d35b-4a8c-9c5e-be37dd688e03 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:24.820000 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c0701121-d35b-4a8c-9c5e-be37dd688e03 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.110430 Nov 12 02:34:24.820821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 536/1044] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:24 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:25.334126 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-991325a7-f0c6-4943-b876-eebeadae347d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:25.334704 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-991325a7-f0c6-4943-b876-eebeadae347d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:25.341484 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-991325a7-f0c6-4943-b876-eebeadae347d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:25.341951 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-991325a7-f0c6-4943-b876-eebeadae347d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:25.342750 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-991325a7-f0c6-4943-b876-eebeadae347d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:25.343185 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-991325a7-f0c6-4943-b876-eebeadae347d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:25.356790 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-991325a7-f0c6-4943-b876-eebeadae347d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] HTTP exception thrown: Instance 5c1ce3bd-1739-49be-ab2e-e81c1026ae30 could not be found. Nov 12 02:34:25.357379 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-991325a7-f0c6-4943-b876-eebeadae347d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Returning 404 to user: Instance 5c1ce3bd-1739-49be-ab2e-e81c1026ae30 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:34:25.358202 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-991325a7-f0c6-4943-b876-eebeadae347d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 404 len: 111 microversion: 2.1 time: 0.027916 Nov 12 02:34:25.358767 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 509/1045] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:25 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 12 02:34:25.368463 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8cb40d2d-74d0-4a17-a8ff-1bec9d8adee3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '.version_select at 0x7fc0645d4790>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:25.392554 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8cb40d2d-74d0-4a17-a8ff-1bec9d8adee3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-20366487" status: 202 len: 0 microversion: 2.1 time: 0.028256 Nov 12 02:34:25.393619 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 537/1046] 10.222.0.70 () {58 vars in 1214 bytes} [Fri Nov 12 02:34:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-20366487 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:34:25.835292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bc232aed-928d-49e2-8929-f004b5ff3dcd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:25.837031 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bc232aed-928d-49e2-8929-f004b5ff3dcd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:25.848038 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bc232aed-928d-49e2-8929-f004b5ff3dcd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:25.848862 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bc232aed-928d-49e2-8929-f004b5ff3dcd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:25.850258 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bc232aed-928d-49e2-8929-f004b5ff3dcd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:25.850731 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bc232aed-928d-49e2-8929-f004b5ff3dcd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:26.112082 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e145196e-29c9-4668-837d-04c70e034275 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'create', calling method: .version_select at 0x7fc0645b44c0>, body: {"keypair": {"name": "tempest-keypair-1116387881"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:26.127818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-e145196e-29c9-4668-837d-04c70e034275 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Getting quotas for project 77e4b228dda14fa7852c7fe639ed28b0. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:34:26.132464 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-e145196e-29c9-4668-837d-04c70e034275 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Getting quotas for user 808aadbd72b54806add54c601d755481 and project 77e4b228dda14fa7852c7fe639ed28b0. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:34:26.211911 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-e145196e-29c9-4668-837d-04c70e034275 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Getting quotas for project 77e4b228dda14fa7852c7fe639ed28b0. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:34:26.215430 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-e145196e-29c9-4668-837d-04c70e034275 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Getting quotas for user 808aadbd72b54806add54c601d755481 and project 77e4b228dda14fa7852c7fe639ed28b0. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:34:26.229218 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e145196e-29c9-4668-837d-04c70e034275 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.121253 Nov 12 02:34:26.229861 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 538/1047] 10.222.0.70 () {60 vars in 1157 bytes} [Fri Nov 12 02:34:26 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:34:27.518782 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1370817980", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38363d6e-af24-4ec9-9ca9-8c61a2487f51"}], "security_groups": [{"name": "tempest-securitygroup--549255659"}], "key_name": "tempest-keypair-1116387881", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:27.625094 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.network.neutron [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] validate_networks() for [('38363d6e-af24-4ec9-9ca9-8c61a2487f51', None, None, None, None, None)] {{(pid=116099) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:34:28.020681 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Flavor limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:34:28.021110 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Image limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:34:28.021588 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Flavor pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:34:28.022003 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Image pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:34:28.022447 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:34:28.032208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:28.032709 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:28.033647 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:28.034126 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:28.050757 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Getting quotas for project 77e4b228dda14fa7852c7fe639ed28b0. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:34:28.055219 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Getting quotas for user 808aadbd72b54806add54c601d755481 and project 77e4b228dda14fa7852c7fe639ed28b0. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:34:28.065957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Going to run 1 instances... {{(pid=116099) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:34:28.068355 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:34:28.113759 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3e24d8ed-1849-442b-9241-17393f592591 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.600268 Nov 12 02:34:28.114403 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 539/1048] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:34:27 2021] POST /compute/v2.1/servers => generated 401 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 12 02:34:28.125042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7066eed9-4017-4050-af4e-f71ac6791d30 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:28.125651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7066eed9-4017-4050-af4e-f71ac6791d30 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:28.182551 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7066eed9-4017-4050-af4e-f71ac6791d30 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:28.193222 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7066eed9-4017-4050-af4e-f71ac6791d30 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1238 microversion: 2.1 time: 0.071532 Nov 12 02:34:28.193676 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 540/1049] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:28 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:34:29.212092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5d06960f-17db-43d3-92f6-d7ff5f80aae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:29.212771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5d06960f-17db-43d3-92f6-d7ff5f80aae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:29.219555 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d06960f-17db-43d3-92f6-d7ff5f80aae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:29.220002 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d06960f-17db-43d3-92f6-d7ff5f80aae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:29.220779 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d06960f-17db-43d3-92f6-d7ff5f80aae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:29.221208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d06960f-17db-43d3-92f6-d7ff5f80aae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:29.281667 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5d06960f-17db-43d3-92f6-d7ff5f80aae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:29.289029 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5d06960f-17db-43d3-92f6-d7ff5f80aae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1242 microversion: 2.1 time: 0.081153 Nov 12 02:34:29.289694 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 541/1050] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:29 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:34:29.799687 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bc232aed-928d-49e2-8929-f004b5ff3dcd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 3.971445 Nov 12 02:34:29.803550 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 510/1051] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:25 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 3973 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:30.305082 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1e773371-63d9-4da5-a4de-d4c7a8465980 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:30.305694 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1e773371-63d9-4da5-a4de-d4c7a8465980 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:30.312033 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1e773371-63d9-4da5-a4de-d4c7a8465980 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:30.312489 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1e773371-63d9-4da5-a4de-d4c7a8465980 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:30.313271 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1e773371-63d9-4da5-a4de-d4c7a8465980 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:30.313708 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1e773371-63d9-4da5-a4de-d4c7a8465980 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:30.380042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1e773371-63d9-4da5-a4de-d4c7a8465980 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:30.387960 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1e773371-63d9-4da5-a4de-d4c7a8465980 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1290 microversion: 2.1 time: 0.086536 Nov 12 02:34:30.388518 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 542/1052] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:30 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:30.811625 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8cca35ac-87cc-4bc9-bff8-3bb0ab1e7fd8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:30.812628 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8cca35ac-87cc-4bc9-bff8-3bb0ab1e7fd8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:30.821655 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8cca35ac-87cc-4bc9-bff8-3bb0ab1e7fd8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:30.822109 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8cca35ac-87cc-4bc9-bff8-3bb0ab1e7fd8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:30.822931 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8cca35ac-87cc-4bc9-bff8-3bb0ab1e7fd8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:30.823650 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8cca35ac-87cc-4bc9-bff8-3bb0ab1e7fd8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:30.912387 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8cca35ac-87cc-4bc9-bff8-3bb0ab1e7fd8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.104619 Nov 12 02:34:30.913351 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 511/1053] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:30 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:31.407268 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d76f2263-1be3-4cd0-a87a-6f5356014da4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:31.408007 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d76f2263-1be3-4cd0-a87a-6f5356014da4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:31.415026 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d76f2263-1be3-4cd0-a87a-6f5356014da4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:31.415475 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d76f2263-1be3-4cd0-a87a-6f5356014da4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:31.416472 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d76f2263-1be3-4cd0-a87a-6f5356014da4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:31.417079 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d76f2263-1be3-4cd0-a87a-6f5356014da4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:31.675269 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d76f2263-1be3-4cd0-a87a-6f5356014da4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:31.684521 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d76f2263-1be3-4cd0-a87a-6f5356014da4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1363 microversion: 2.1 time: 0.280977 Nov 12 02:34:31.685578 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 543/1054] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:31 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:31.924870 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ab1325f5-a702-4d19-9706-0830f4e44eb9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:31.927978 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ab1325f5-a702-4d19-9706-0830f4e44eb9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:31.935946 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ab1325f5-a702-4d19-9706-0830f4e44eb9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:31.936781 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ab1325f5-a702-4d19-9706-0830f4e44eb9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:31.937828 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ab1325f5-a702-4d19-9706-0830f4e44eb9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:31.938526 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ab1325f5-a702-4d19-9706-0830f4e44eb9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:32.024899 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-98cfe69a-87fc-4c8f-bfe0-972e547efb10 req-9b126060-fde0-4ed4-bd5d-eed060d9650b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfe1c1de-88eb-40a0-8799-5cc1dec271f5", "tag": "5888bc48-d959-49a9-a8ab-cc91e012e935"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:32.026653 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:34:32.026653 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:34:32.034768 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-98cfe69a-87fc-4c8f-bfe0-972e547efb10 req-9b126060-fde0-4ed4-bd5d-eed060d9650b service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:32.035207 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-98cfe69a-87fc-4c8f-bfe0-972e547efb10 req-9b126060-fde0-4ed4-bd5d-eed060d9650b service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:32.047462 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-98cfe69a-87fc-4c8f-bfe0-972e547efb10 req-9b126060-fde0-4ed4-bd5d-eed060d9650b service nova] Creating event network-changed:5888bc48-d959-49a9-a8ab-cc91e012e935 for instance dfe1c1de-88eb-40a0-8799-5cc1dec271f5 on hv-cinder-80857 Nov 12 02:34:32.055414 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ab1325f5-a702-4d19-9706-0830f4e44eb9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.134533 Nov 12 02:34:32.056135 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 512/1055] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:31 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:34:32.057573 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-98cfe69a-87fc-4c8f-bfe0-972e547efb10 req-9b126060-fde0-4ed4-bd5d-eed060d9650b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037230 Nov 12 02:34:32.058364 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 544/1056] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:34:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:34:32.701681 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-40950730-fb03-4727-a945-7d3a425150a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:32.702375 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-40950730-fb03-4727-a945-7d3a425150a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:32.709390 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-40950730-fb03-4727-a945-7d3a425150a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:32.710375 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-40950730-fb03-4727-a945-7d3a425150a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:32.711166 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-40950730-fb03-4727-a945-7d3a425150a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:32.711596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-40950730-fb03-4727-a945-7d3a425150a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:32.938277 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-40950730-fb03-4727-a945-7d3a425150a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:32.946831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-40950730-fb03-4727-a945-7d3a425150a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1363 microversion: 2.1 time: 0.249160 Nov 12 02:34:32.947406 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 513/1057] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:32 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:33.068531 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f300a0a7-7539-41d5-803e-2b9270d59ddd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:33.070092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f300a0a7-7539-41d5-803e-2b9270d59ddd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:33.076167 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f300a0a7-7539-41d5-803e-2b9270d59ddd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:33.076620 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f300a0a7-7539-41d5-803e-2b9270d59ddd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:33.077403 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f300a0a7-7539-41d5-803e-2b9270d59ddd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:33.077858 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f300a0a7-7539-41d5-803e-2b9270d59ddd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:33.176448 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f300a0a7-7539-41d5-803e-2b9270d59ddd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.112210 Nov 12 02:34:33.177288 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 545/1058] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:33 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:33.963975 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5f9e67ac-6baf-44c9-9db4-ec91016a27d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:33.964583 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5f9e67ac-6baf-44c9-9db4-ec91016a27d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:33.970918 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f9e67ac-6baf-44c9-9db4-ec91016a27d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:33.971371 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f9e67ac-6baf-44c9-9db4-ec91016a27d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:33.972161 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f9e67ac-6baf-44c9-9db4-ec91016a27d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:33.972575 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5f9e67ac-6baf-44c9-9db4-ec91016a27d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:34.106292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5f9e67ac-6baf-44c9-9db4-ec91016a27d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:34.114536 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5f9e67ac-6baf-44c9-9db4-ec91016a27d2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1363 microversion: 2.1 time: 0.154167 Nov 12 02:34:34.115057 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 514/1059] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:33 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:34.189181 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-68a1c9d1-3ef2-44cd-ac74-0b185212df24 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:34.190302 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-68a1c9d1-3ef2-44cd-ac74-0b185212df24 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:34.197986 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-68a1c9d1-3ef2-44cd-ac74-0b185212df24 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:34.198438 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-68a1c9d1-3ef2-44cd-ac74-0b185212df24 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:34.199268 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-68a1c9d1-3ef2-44cd-ac74-0b185212df24 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:34.199702 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-68a1c9d1-3ef2-44cd-ac74-0b185212df24 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:34.372117 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-68a1c9d1-3ef2-44cd-ac74-0b185212df24 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.187176 Nov 12 02:34:34.372795 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 546/1060] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:34 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:34.406120 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:34:34.406376 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: Fri Nov 12 02:34:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:34:35.131313 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cd2a36fc-c001-42c2-be5c-0877e05cc262 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:35.132546 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cd2a36fc-c001-42c2-be5c-0877e05cc262 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:35.139609 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd2a36fc-c001-42c2-be5c-0877e05cc262 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:35.139911 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd2a36fc-c001-42c2-be5c-0877e05cc262 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:35.140475 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd2a36fc-c001-42c2-be5c-0877e05cc262 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:35.140922 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd2a36fc-c001-42c2-be5c-0877e05cc262 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:35.283283 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cd2a36fc-c001-42c2-be5c-0877e05cc262 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:35.290573 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cd2a36fc-c001-42c2-be5c-0877e05cc262 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1363 microversion: 2.1 time: 0.162982 Nov 12 02:34:35.291160 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 515/1061] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:35 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:35.385111 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5608dcb4-98e2-4e36-a753-b8ec8499802d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:35.386011 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5608dcb4-98e2-4e36-a753-b8ec8499802d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:35.393003 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5608dcb4-98e2-4e36-a753-b8ec8499802d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:35.393446 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5608dcb4-98e2-4e36-a753-b8ec8499802d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:35.394229 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5608dcb4-98e2-4e36-a753-b8ec8499802d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:35.394687 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5608dcb4-98e2-4e36-a753-b8ec8499802d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:35.481361 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5608dcb4-98e2-4e36-a753-b8ec8499802d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.100741 Nov 12 02:34:35.482000 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 547/1062] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:35 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:34:36.307573 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-88aef466-60f6-47a1-b3c6-031eb24f87db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:36.308191 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-88aef466-60f6-47a1-b3c6-031eb24f87db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:36.314466 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-88aef466-60f6-47a1-b3c6-031eb24f87db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:36.314984 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-88aef466-60f6-47a1-b3c6-031eb24f87db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:36.315740 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-88aef466-60f6-47a1-b3c6-031eb24f87db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:36.316175 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-88aef466-60f6-47a1-b3c6-031eb24f87db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:36.465422 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-88aef466-60f6-47a1-b3c6-031eb24f87db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:36.472837 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-88aef466-60f6-47a1-b3c6-031eb24f87db tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1363 microversion: 2.1 time: 0.169325 Nov 12 02:34:36.473410 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 516/1063] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:36 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:36.494052 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-51b138a2-ab53-4555-ac4d-cb67702d6351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:36.495072 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-51b138a2-ab53-4555-ac4d-cb67702d6351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:36.501974 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-51b138a2-ab53-4555-ac4d-cb67702d6351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:36.502422 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-51b138a2-ab53-4555-ac4d-cb67702d6351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:36.503235 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-51b138a2-ab53-4555-ac4d-cb67702d6351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:36.503671 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-51b138a2-ab53-4555-ac4d-cb67702d6351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:36.602587 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-51b138a2-ab53-4555-ac4d-cb67702d6351 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.112685 Nov 12 02:34:36.603559 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 548/1064] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:36 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:37.492810 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f284f1d9-b5b8-4777-a0fc-da83d6639ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:37.493513 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f284f1d9-b5b8-4777-a0fc-da83d6639ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:37.499717 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f284f1d9-b5b8-4777-a0fc-da83d6639ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:37.500164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f284f1d9-b5b8-4777-a0fc-da83d6639ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:37.500943 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f284f1d9-b5b8-4777-a0fc-da83d6639ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:37.501381 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f284f1d9-b5b8-4777-a0fc-da83d6639ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:37.615189 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8276871a-d760-446d-869b-fbda6f195cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:37.616751 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8276871a-d760-446d-869b-fbda6f195cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:37.623764 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8276871a-d760-446d-869b-fbda6f195cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:37.624208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8276871a-d760-446d-869b-fbda6f195cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:37.624975 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8276871a-d760-446d-869b-fbda6f195cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:37.625407 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8276871a-d760-446d-869b-fbda6f195cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:37.632977 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f284f1d9-b5b8-4777-a0fc-da83d6639ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:37.640405 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f284f1d9-b5b8-4777-a0fc-da83d6639ad0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1363 microversion: 2.1 time: 0.152206 Nov 12 02:34:37.641132 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 517/1065] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:37 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:37.716436 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8276871a-d760-446d-869b-fbda6f195cc4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.104983 Nov 12 02:34:37.717117 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 549/1066] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:37 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:34:38.658649 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e92b3c28-b42a-4200-8e79-bfc5b80e66f8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:38.659719 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e92b3c28-b42a-4200-8e79-bfc5b80e66f8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:38.667079 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e92b3c28-b42a-4200-8e79-bfc5b80e66f8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:38.667611 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e92b3c28-b42a-4200-8e79-bfc5b80e66f8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:38.668482 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e92b3c28-b42a-4200-8e79-bfc5b80e66f8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:38.669012 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e92b3c28-b42a-4200-8e79-bfc5b80e66f8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:38.729835 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e2026ce4-beef-4238-bda6-3801e7712999 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:38.731867 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e2026ce4-beef-4238-bda6-3801e7712999 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:38.740366 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e2026ce4-beef-4238-bda6-3801e7712999 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:38.741333 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e2026ce4-beef-4238-bda6-3801e7712999 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:38.742564 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e2026ce4-beef-4238-bda6-3801e7712999 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:38.743543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e2026ce4-beef-4238-bda6-3801e7712999 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:38.838111 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e2026ce4-beef-4238-bda6-3801e7712999 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.112749 Nov 12 02:34:38.838822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 550/1067] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:38 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:34:38.849112 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e92b3c28-b42a-4200-8e79-bfc5b80e66f8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:38.857351 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e92b3c28-b42a-4200-8e79-bfc5b80e66f8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1363 microversion: 2.1 time: 0.203449 Nov 12 02:34:38.857919 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 518/1068] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:38 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:39.849683 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-818a123f-fc68-4429-b73a-0f2423325423 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:39.850735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-818a123f-fc68-4429-b73a-0f2423325423 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:39.858037 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-818a123f-fc68-4429-b73a-0f2423325423 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:39.858484 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-818a123f-fc68-4429-b73a-0f2423325423 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:39.859295 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-818a123f-fc68-4429-b73a-0f2423325423 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:39.859723 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-818a123f-fc68-4429-b73a-0f2423325423 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:39.874162 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c6223a77-645f-4ddc-b78c-0b3aba30e499 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:39.874162 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c6223a77-645f-4ddc-b78c-0b3aba30e499 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:39.880447 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c6223a77-645f-4ddc-b78c-0b3aba30e499 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:39.880447 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c6223a77-645f-4ddc-b78c-0b3aba30e499 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:39.880936 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c6223a77-645f-4ddc-b78c-0b3aba30e499 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:39.881874 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c6223a77-645f-4ddc-b78c-0b3aba30e499 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:39.978935 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-818a123f-fc68-4429-b73a-0f2423325423 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.132878 Nov 12 02:34:39.980601 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 551/1069] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:39 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:39.997062 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-d5ad1fe4-6a83-4bff-90d1-1bd181de2fc8 req-3dcd85a5-831a-4f93-b429-e155c6c412f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe1c1de-88eb-40a0-8799-5cc1dec271f5", "name": "network-vif-plugged", "status": "completed", "tag": "5888bc48-d959-49a9-a8ab-cc91e012e935"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:39.998922 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:34:39.998922 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:34:40.010474 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-d5ad1fe4-6a83-4bff-90d1-1bd181de2fc8 req-3dcd85a5-831a-4f93-b429-e155c6c412f9 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:40.010885 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-d5ad1fe4-6a83-4bff-90d1-1bd181de2fc8 req-3dcd85a5-831a-4f93-b429-e155c6c412f9 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:40.024341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-d5ad1fe4-6a83-4bff-90d1-1bd181de2fc8 req-3dcd85a5-831a-4f93-b429-e155c6c412f9 service nova] Creating event network-vif-plugged:5888bc48-d959-49a9-a8ab-cc91e012e935 for instance dfe1c1de-88eb-40a0-8799-5cc1dec271f5 on hv-cinder-80857 Nov 12 02:34:40.029262 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-d5ad1fe4-6a83-4bff-90d1-1bd181de2fc8 req-3dcd85a5-831a-4f93-b429-e155c6c412f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036237 Nov 12 02:34:40.030240 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 552/1070] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:34:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:34:40.039086 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c6223a77-645f-4ddc-b78c-0b3aba30e499 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:40.046630 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c6223a77-645f-4ddc-b78c-0b3aba30e499 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1363 microversion: 2.1 time: 0.176897 Nov 12 02:34:40.047538 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 519/1071] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:39 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:34:40.992771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-828d4c28-f686-4eb1-91f8-dfdc7b0b8194 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:40.993759 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-828d4c28-f686-4eb1-91f8-dfdc7b0b8194 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:41.004958 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-828d4c28-f686-4eb1-91f8-dfdc7b0b8194 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:41.005399 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-828d4c28-f686-4eb1-91f8-dfdc7b0b8194 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:41.006178 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-828d4c28-f686-4eb1-91f8-dfdc7b0b8194 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:41.006606 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-828d4c28-f686-4eb1-91f8-dfdc7b0b8194 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:41.063767 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dd572b37-ac7e-4f2e-bc59-587abe38778e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:41.064387 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dd572b37-ac7e-4f2e-bc59-587abe38778e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:41.070640 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd572b37-ac7e-4f2e-bc59-587abe38778e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:41.071122 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd572b37-ac7e-4f2e-bc59-587abe38778e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:41.071914 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd572b37-ac7e-4f2e-bc59-587abe38778e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:41.072354 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dd572b37-ac7e-4f2e-bc59-587abe38778e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:41.110643 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-828d4c28-f686-4eb1-91f8-dfdc7b0b8194 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.122380 Nov 12 02:34:41.111956 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 553/1072] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:40 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:41.224878 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dd572b37-ac7e-4f2e-bc59-587abe38778e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:41.232961 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dd572b37-ac7e-4f2e-bc59-587abe38778e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1363 microversion: 2.1 time: 0.172736 Nov 12 02:34:41.233541 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 520/1073] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:41 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:34:42.123012 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7c284839-8e9e-4fd6-b773-0b21cf79d980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:42.124015 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7c284839-8e9e-4fd6-b773-0b21cf79d980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:42.131573 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7c284839-8e9e-4fd6-b773-0b21cf79d980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:42.132067 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7c284839-8e9e-4fd6-b773-0b21cf79d980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:42.132869 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7c284839-8e9e-4fd6-b773-0b21cf79d980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:42.133308 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7c284839-8e9e-4fd6-b773-0b21cf79d980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:42.217202 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7c284839-8e9e-4fd6-b773-0b21cf79d980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.098195 Nov 12 02:34:42.217844 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 554/1074] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:42 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:42.249749 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-65e5940d-0258-4092-b54e-4917fd177d8d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:42.250374 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-65e5940d-0258-4092-b54e-4917fd177d8d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:42.256776 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-65e5940d-0258-4092-b54e-4917fd177d8d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:42.257225 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-65e5940d-0258-4092-b54e-4917fd177d8d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:42.258019 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-65e5940d-0258-4092-b54e-4917fd177d8d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:42.258461 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-65e5940d-0258-4092-b54e-4917fd177d8d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:42.400648 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-65e5940d-0258-4092-b54e-4917fd177d8d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:34:42.408242 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-65e5940d-0258-4092-b54e-4917fd177d8d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1549 microversion: 2.1 time: 0.162089 Nov 12 02:34:42.408942 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 521/1075] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:34:42 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:34:42.427385 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-760d881b-70dc-4670-9899-86ba9147281d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:34:42.427955 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-760d881b-70dc-4670-9899-86ba9147281d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:42.435794 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-760d881b-70dc-4670-9899-86ba9147281d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:42.436233 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-760d881b-70dc-4670-9899-86ba9147281d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:42.437138 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-760d881b-70dc-4670-9899-86ba9147281d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:42.437565 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-760d881b-70dc-4670-9899-86ba9147281d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:42.524915 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-760d881b-70dc-4670-9899-86ba9147281d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101688 Nov 12 02:34:42.525544 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 555/1076] 10.222.0.70 () {58 vars in 1274 bytes} [Fri Nov 12 02:34:42 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:34:43.230091 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-23d1c3aa-3e1f-4431-8eb0-d859426be830 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:43.235317 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-23d1c3aa-3e1f-4431-8eb0-d859426be830 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:43.242435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23d1c3aa-3e1f-4431-8eb0-d859426be830 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:43.243017 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23d1c3aa-3e1f-4431-8eb0-d859426be830 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:43.243884 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23d1c3aa-3e1f-4431-8eb0-d859426be830 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:43.244389 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-23d1c3aa-3e1f-4431-8eb0-d859426be830 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:43.332748 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-23d1c3aa-3e1f-4431-8eb0-d859426be830 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.107359 Nov 12 02:34:43.333407 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 522/1077] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:43 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:43.785012 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-dd6a77f6-ea95-4a71-9de2-963bf7f2f6bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:43.785936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-dd6a77f6-ea95-4a71-9de2-963bf7f2f6bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:43.790327 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-7d7b2f5d-196f-4339-9676-8fa14a0e1143 req-70ba7a94-6777-472d-aa68-36d814241307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfe1c1de-88eb-40a0-8799-5cc1dec271f5", "tag": "5888bc48-d959-49a9-a8ab-cc91e012e935"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:43.792045 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:34:43.792045 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:34:43.793045 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dd6a77f6-ea95-4a71-9de2-963bf7f2f6bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:43.793503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dd6a77f6-ea95-4a71-9de2-963bf7f2f6bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:43.794295 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dd6a77f6-ea95-4a71-9de2-963bf7f2f6bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:43.795007 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dd6a77f6-ea95-4a71-9de2-963bf7f2f6bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:43.800595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-7d7b2f5d-196f-4339-9676-8fa14a0e1143 req-70ba7a94-6777-472d-aa68-36d814241307 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:43.801047 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-7d7b2f5d-196f-4339-9676-8fa14a0e1143 req-70ba7a94-6777-472d-aa68-36d814241307 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:43.812701 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-7d7b2f5d-196f-4339-9676-8fa14a0e1143 req-70ba7a94-6777-472d-aa68-36d814241307 service nova] Creating event network-changed:5888bc48-d959-49a9-a8ab-cc91e012e935 for instance dfe1c1de-88eb-40a0-8799-5cc1dec271f5 on hv-cinder-80857 Nov 12 02:34:43.817579 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-7d7b2f5d-196f-4339-9676-8fa14a0e1143 req-70ba7a94-6777-472d-aa68-36d814241307 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032188 Nov 12 02:34:43.818503 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 523/1078] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:34:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:34:43.914881 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-dd6a77f6-ea95-4a71-9de2-963bf7f2f6bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 14 microversion: 2.1 time: 0.133710 Nov 12 02:34:43.915634 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 556/1079] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:43 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:34:44.348520 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ea195825-65a6-4fcc-b257-32bb84376b3c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:44.350372 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ea195825-65a6-4fcc-b257-32bb84376b3c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:44.356750 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ea195825-65a6-4fcc-b257-32bb84376b3c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:44.357507 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ea195825-65a6-4fcc-b257-32bb84376b3c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:44.358309 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ea195825-65a6-4fcc-b257-32bb84376b3c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:44.358803 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ea195825-65a6-4fcc-b257-32bb84376b3c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:44.456001 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ea195825-65a6-4fcc-b257-32bb84376b3c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28175 microversion: 2.20 time: 0.113841 Nov 12 02:34:44.456747 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 524/1080] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:44 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28175 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:44.925955 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9002dcc8-de0a-4058-ba05-a8615662a601 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:44.926888 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9002dcc8-de0a-4058-ba05-a8615662a601 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:44.934857 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9002dcc8-de0a-4058-ba05-a8615662a601 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:44.935306 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9002dcc8-de0a-4058-ba05-a8615662a601 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:44.936091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9002dcc8-de0a-4058-ba05-a8615662a601 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:44.936525 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9002dcc8-de0a-4058-ba05-a8615662a601 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:45.030649 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9002dcc8-de0a-4058-ba05-a8615662a601 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 14 microversion: 2.1 time: 0.108586 Nov 12 02:34:45.031490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 557/1081] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:44 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:34:45.470102 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6583d8af-7478-4b8b-835b-f8580c323578 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:45.471140 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6583d8af-7478-4b8b-835b-f8580c323578 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:45.479344 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6583d8af-7478-4b8b-835b-f8580c323578 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:45.479793 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6583d8af-7478-4b8b-835b-f8580c323578 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:45.480575 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6583d8af-7478-4b8b-835b-f8580c323578 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:45.481006 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6583d8af-7478-4b8b-835b-f8580c323578 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:45.585289 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6583d8af-7478-4b8b-835b-f8580c323578 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28466 microversion: 2.20 time: 0.118453 Nov 12 02:34:45.585870 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 525/1082] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:45 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28466 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:46.042255 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-173e7c59-a0ad-403e-8f83-4f5c2152db68 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:46.043291 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-173e7c59-a0ad-403e-8f83-4f5c2152db68 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:46.050591 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-173e7c59-a0ad-403e-8f83-4f5c2152db68 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:46.051073 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-173e7c59-a0ad-403e-8f83-4f5c2152db68 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:46.051859 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-173e7c59-a0ad-403e-8f83-4f5c2152db68 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:46.052300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-173e7c59-a0ad-403e-8f83-4f5c2152db68 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:46.136511 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-173e7c59-a0ad-403e-8f83-4f5c2152db68 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 14 microversion: 2.1 time: 0.098071 Nov 12 02:34:46.136981 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 558/1083] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:46 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:34:46.596946 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-023f8b15-dbb9-4acf-a70b-eab56659a31f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:46.597979 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-023f8b15-dbb9-4acf-a70b-eab56659a31f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:46.605568 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-023f8b15-dbb9-4acf-a70b-eab56659a31f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:46.606018 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-023f8b15-dbb9-4acf-a70b-eab56659a31f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:46.606832 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-023f8b15-dbb9-4acf-a70b-eab56659a31f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:46.607276 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-023f8b15-dbb9-4acf-a70b-eab56659a31f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:46.694978 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-023f8b15-dbb9-4acf-a70b-eab56659a31f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28466 microversion: 2.20 time: 0.102029 Nov 12 02:34:46.695630 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 526/1084] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:46 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28466 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:47.149520 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3fd9e892-3dce-4b21-8076-eab6daff0276 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:47.151227 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3fd9e892-3dce-4b21-8076-eab6daff0276 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:47.158378 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3fd9e892-3dce-4b21-8076-eab6daff0276 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:47.158787 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3fd9e892-3dce-4b21-8076-eab6daff0276 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:47.159586 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3fd9e892-3dce-4b21-8076-eab6daff0276 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:47.160029 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3fd9e892-3dce-4b21-8076-eab6daff0276 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:47.248526 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3fd9e892-3dce-4b21-8076-eab6daff0276 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 14 microversion: 2.1 time: 0.105085 Nov 12 02:34:47.249200 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 559/1085] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:47 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:34:47.706605 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-416dbb26-3f3e-4c4c-96ca-75852af1ee28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:47.707881 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-416dbb26-3f3e-4c4c-96ca-75852af1ee28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:47.715413 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-416dbb26-3f3e-4c4c-96ca-75852af1ee28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:47.716007 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-416dbb26-3f3e-4c4c-96ca-75852af1ee28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:47.717038 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-416dbb26-3f3e-4c4c-96ca-75852af1ee28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:47.717513 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-416dbb26-3f3e-4c4c-96ca-75852af1ee28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:47.827893 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-416dbb26-3f3e-4c4c-96ca-75852af1ee28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.125196 Nov 12 02:34:47.828541 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 527/1086] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:47 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:48.263995 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-66b863aa-eeb8-48a4-9001-fbdb15e646bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:48.264992 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-66b863aa-eeb8-48a4-9001-fbdb15e646bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:48.272450 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-66b863aa-eeb8-48a4-9001-fbdb15e646bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:48.272898 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-66b863aa-eeb8-48a4-9001-fbdb15e646bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:48.273688 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-66b863aa-eeb8-48a4-9001-fbdb15e646bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:48.274125 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-66b863aa-eeb8-48a4-9001-fbdb15e646bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:48.354132 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-66b863aa-eeb8-48a4-9001-fbdb15e646bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 14 microversion: 2.1 time: 0.097922 Nov 12 02:34:48.355473 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 560/1087] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:48 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:34:48.840294 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5a2f47e9-80dc-4888-b927-cfda2d1006a9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:48.841291 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5a2f47e9-80dc-4888-b927-cfda2d1006a9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:48.848226 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a2f47e9-80dc-4888-b927-cfda2d1006a9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:48.848675 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a2f47e9-80dc-4888-b927-cfda2d1006a9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:48.849463 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a2f47e9-80dc-4888-b927-cfda2d1006a9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:48.850404 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a2f47e9-80dc-4888-b927-cfda2d1006a9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:48.939434 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5a2f47e9-80dc-4888-b927-cfda2d1006a9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.098625 Nov 12 02:34:48.940967 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 528/1088] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:48 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:49.365064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-908d34d8-148a-4e96-b54e-b74b5a1e44a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:49.366106 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-908d34d8-148a-4e96-b54e-b74b5a1e44a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:49.373452 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-908d34d8-148a-4e96-b54e-b74b5a1e44a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:49.373901 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-908d34d8-148a-4e96-b54e-b74b5a1e44a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:49.374710 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-908d34d8-148a-4e96-b54e-b74b5a1e44a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:49.375150 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-908d34d8-148a-4e96-b54e-b74b5a1e44a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:49.461175 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-908d34d8-148a-4e96-b54e-b74b5a1e44a4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 14 microversion: 2.1 time: 0.099828 Nov 12 02:34:49.461759 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 561/1089] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:49 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:34:49.953724 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a6731faa-0141-4f8f-9b27-a279b3445251 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:49.954953 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a6731faa-0141-4f8f-9b27-a279b3445251 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:49.962340 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6731faa-0141-4f8f-9b27-a279b3445251 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:49.962819 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6731faa-0141-4f8f-9b27-a279b3445251 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:49.963620 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6731faa-0141-4f8f-9b27-a279b3445251 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:49.964057 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6731faa-0141-4f8f-9b27-a279b3445251 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:50.050771 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a6731faa-0141-4f8f-9b27-a279b3445251 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.100798 Nov 12 02:34:50.051594 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 529/1090] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:49 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:50.472700 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7af240a8-8e49-4b4a-833e-10a7d4f526c7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:50.473698 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7af240a8-8e49-4b4a-833e-10a7d4f526c7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:50.481251 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7af240a8-8e49-4b4a-833e-10a7d4f526c7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:50.481698 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7af240a8-8e49-4b4a-833e-10a7d4f526c7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:50.482483 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7af240a8-8e49-4b4a-833e-10a7d4f526c7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:50.482942 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7af240a8-8e49-4b4a-833e-10a7d4f526c7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:50.565256 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7af240a8-8e49-4b4a-833e-10a7d4f526c7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 14 microversion: 2.1 time: 0.096361 Nov 12 02:34:50.565890 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 562/1091] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:50 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 12 02:34:51.063582 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c440d5db-3ac0-4a51-98b5-c00169e96ca4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:51.064600 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c440d5db-3ac0-4a51-98b5-c00169e96ca4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:51.072967 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c440d5db-3ac0-4a51-98b5-c00169e96ca4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:51.073419 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c440d5db-3ac0-4a51-98b5-c00169e96ca4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:51.074224 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c440d5db-3ac0-4a51-98b5-c00169e96ca4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:51.074680 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c440d5db-3ac0-4a51-98b5-c00169e96ca4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:51.167353 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c440d5db-3ac0-4a51-98b5-c00169e96ca4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.107631 Nov 12 02:34:51.168297 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 530/1092] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:51 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:51.576888 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-70cbefb2-a5a5-4a49-aa81-6b5899458189 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:51.577919 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-70cbefb2-a5a5-4a49-aa81-6b5899458189 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:51.585470 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-70cbefb2-a5a5-4a49-aa81-6b5899458189 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:51.585919 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-70cbefb2-a5a5-4a49-aa81-6b5899458189 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:51.586730 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-70cbefb2-a5a5-4a49-aa81-6b5899458189 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:51.587181 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-70cbefb2-a5a5-4a49-aa81-6b5899458189 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:51.677249 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-70cbefb2-a5a5-4a49-aa81-6b5899458189 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 14 microversion: 2.1 time: 0.104226 Nov 12 02:34:51.677914 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 563/1093] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:51 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:34:52.180193 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a7c276e3-ba88-4bc2-97a7-315e64500ff5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:52.181200 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a7c276e3-ba88-4bc2-97a7-315e64500ff5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:52.188303 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a7c276e3-ba88-4bc2-97a7-315e64500ff5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:52.188754 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a7c276e3-ba88-4bc2-97a7-315e64500ff5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:52.189551 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a7c276e3-ba88-4bc2-97a7-315e64500ff5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:52.189986 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a7c276e3-ba88-4bc2-97a7-315e64500ff5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:52.280540 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a7c276e3-ba88-4bc2-97a7-315e64500ff5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.104722 Nov 12 02:34:52.281204 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 531/1094] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:52 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:52.688928 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4e2eadd2-f3e3-435c-b132-b1766baa7ca0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:52.689921 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4e2eadd2-f3e3-435c-b132-b1766baa7ca0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:52.696801 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e2eadd2-f3e3-435c-b132-b1766baa7ca0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:52.697267 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e2eadd2-f3e3-435c-b132-b1766baa7ca0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:52.698047 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e2eadd2-f3e3-435c-b132-b1766baa7ca0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:52.698485 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4e2eadd2-f3e3-435c-b132-b1766baa7ca0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:52.788899 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4e2eadd2-f3e3-435c-b132-b1766baa7ca0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 14 microversion: 2.1 time: 0.103838 Nov 12 02:34:52.789529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 564/1095] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:52 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:34:53.293124 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f80190e9-f0cb-43b8-ba6c-ad2d7b209466 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:53.294126 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f80190e9-f0cb-43b8-ba6c-ad2d7b209466 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:53.301103 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f80190e9-f0cb-43b8-ba6c-ad2d7b209466 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:53.301553 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f80190e9-f0cb-43b8-ba6c-ad2d7b209466 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:53.302347 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f80190e9-f0cb-43b8-ba6c-ad2d7b209466 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:53.302820 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f80190e9-f0cb-43b8-ba6c-ad2d7b209466 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:53.449273 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f80190e9-f0cb-43b8-ba6c-ad2d7b209466 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.159985 Nov 12 02:34:53.449845 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 532/1096] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:53 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:34:53.800338 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6ed2fd6a-166f-4521-af98-c8f1674befcf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:53.801339 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6ed2fd6a-166f-4521-af98-c8f1674befcf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:53.809097 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ed2fd6a-166f-4521-af98-c8f1674befcf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:53.809547 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ed2fd6a-166f-4521-af98-c8f1674befcf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:53.810346 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ed2fd6a-166f-4521-af98-c8f1674befcf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:53.810821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6ed2fd6a-166f-4521-af98-c8f1674befcf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:53.905996 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6ed2fd6a-166f-4521-af98-c8f1674befcf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 14 microversion: 2.1 time: 0.109472 Nov 12 02:34:53.906641 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 565/1097] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:53 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 12 02:34:54.462168 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7c6e0222-25f1-4cc5-9129-54f5ea51c995 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:54.463195 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7c6e0222-25f1-4cc5-9129-54f5ea51c995 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:54.470205 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c6e0222-25f1-4cc5-9129-54f5ea51c995 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:54.470653 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c6e0222-25f1-4cc5-9129-54f5ea51c995 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:54.471466 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c6e0222-25f1-4cc5-9129-54f5ea51c995 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:54.471895 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c6e0222-25f1-4cc5-9129-54f5ea51c995 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:54.563171 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7c6e0222-25f1-4cc5-9129-54f5ea51c995 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.105422 Nov 12 02:34:54.563831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 533/1098] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:54 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:54.917475 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d3c37d94-6073-4638-9f59-e0bad2380ae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:54.918512 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d3c37d94-6073-4638-9f59-e0bad2380ae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:54.925306 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d3c37d94-6073-4638-9f59-e0bad2380ae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:54.925867 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d3c37d94-6073-4638-9f59-e0bad2380ae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:54.926649 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d3c37d94-6073-4638-9f59-e0bad2380ae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:54.927151 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d3c37d94-6073-4638-9f59-e0bad2380ae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:55.016843 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d3c37d94-6073-4638-9f59-e0bad2380ae4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 10009 microversion: 2.1 time: 0.103267 Nov 12 02:34:55.017537 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 566/1099] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:54 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 10009 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:34:55.575783 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9dc0e010-1682-4c07-b164-f58090cf1980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:55.576799 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9dc0e010-1682-4c07-b164-f58090cf1980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:55.583838 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9dc0e010-1682-4c07-b164-f58090cf1980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:55.584292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9dc0e010-1682-4c07-b164-f58090cf1980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:55.585077 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9dc0e010-1682-4c07-b164-f58090cf1980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:55.585509 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9dc0e010-1682-4c07-b164-f58090cf1980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:55.675482 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9dc0e010-1682-4c07-b164-f58090cf1980 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.103867 Nov 12 02:34:55.676456 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 534/1100] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:55 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:56.029417 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5e64544e-87e9-40d6-ad38-2c1ce93cc9e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:56.030505 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5e64544e-87e9-40d6-ad38-2c1ce93cc9e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:56.038305 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5e64544e-87e9-40d6-ad38-2c1ce93cc9e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:56.038788 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5e64544e-87e9-40d6-ad38-2c1ce93cc9e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:56.039583 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5e64544e-87e9-40d6-ad38-2c1ce93cc9e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:56.040023 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5e64544e-87e9-40d6-ad38-2c1ce93cc9e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:56.130724 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5e64544e-87e9-40d6-ad38-2c1ce93cc9e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 17401 microversion: 2.1 time: 0.105299 Nov 12 02:34:56.131877 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 567/1101] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:56 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 17401 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:34:56.688623 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-76a88939-b19e-422e-a91b-5de752b7bf2e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:56.689642 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-76a88939-b19e-422e-a91b-5de752b7bf2e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:56.697426 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76a88939-b19e-422e-a91b-5de752b7bf2e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:56.697878 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76a88939-b19e-422e-a91b-5de752b7bf2e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:56.698694 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76a88939-b19e-422e-a91b-5de752b7bf2e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:56.699141 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-76a88939-b19e-422e-a91b-5de752b7bf2e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:56.800264 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-76a88939-b19e-422e-a91b-5de752b7bf2e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.115568 Nov 12 02:34:56.800934 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 535/1102] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:56 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:57.142642 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-24ec035b-49bd-47c2-8490-76a5fce31acb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:57.143663 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-24ec035b-49bd-47c2-8490-76a5fce31acb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:57.150684 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-24ec035b-49bd-47c2-8490-76a5fce31acb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:57.151131 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-24ec035b-49bd-47c2-8490-76a5fce31acb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:57.151915 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-24ec035b-49bd-47c2-8490-76a5fce31acb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:57.152341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-24ec035b-49bd-47c2-8490-76a5fce31acb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:57.244099 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-24ec035b-49bd-47c2-8490-76a5fce31acb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 18498 microversion: 2.1 time: 0.105373 Nov 12 02:34:57.244752 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 568/1103] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:57 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 18498 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:34:57.813429 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fa34f68b-2897-45a7-bbb2-88f9b226aa48 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:57.814430 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fa34f68b-2897-45a7-bbb2-88f9b226aa48 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:57.823708 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fa34f68b-2897-45a7-bbb2-88f9b226aa48 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:57.824162 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fa34f68b-2897-45a7-bbb2-88f9b226aa48 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:57.826712 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fa34f68b-2897-45a7-bbb2-88f9b226aa48 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:57.827177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fa34f68b-2897-45a7-bbb2-88f9b226aa48 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:57.928395 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fa34f68b-2897-45a7-bbb2-88f9b226aa48 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.118191 Nov 12 02:34:57.929062 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 536/1104] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:57 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:34:58.256230 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9a1d4efc-61f0-4694-a8b7-716ede759223 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:58.257257 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9a1d4efc-61f0-4694-a8b7-716ede759223 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:58.264314 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9a1d4efc-61f0-4694-a8b7-716ede759223 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:58.264761 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9a1d4efc-61f0-4694-a8b7-716ede759223 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:58.265540 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9a1d4efc-61f0-4694-a8b7-716ede759223 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:58.266049 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9a1d4efc-61f0-4694-a8b7-716ede759223 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:58.383544 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9a1d4efc-61f0-4694-a8b7-716ede759223 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 20997 microversion: 2.1 time: 0.131155 Nov 12 02:34:58.384190 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 569/1105] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:58 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 20997 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:34:58.940860 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6f6c571e-003c-4ad0-b933-597ddea48c61 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:58.941868 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6f6c571e-003c-4ad0-b933-597ddea48c61 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:58.948978 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f6c571e-003c-4ad0-b933-597ddea48c61 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:58.949440 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f6c571e-003c-4ad0-b933-597ddea48c61 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:58.950223 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f6c571e-003c-4ad0-b933-597ddea48c61 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:58.950680 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f6c571e-003c-4ad0-b933-597ddea48c61 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:59.035736 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6f6c571e-003c-4ad0-b933-597ddea48c61 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.098813 Nov 12 02:34:59.036419 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 537/1106] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:34:58 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:34:59.394549 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-bd25d6d0-864a-47a1-b1bb-ab7e7b94821b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:34:59.395577 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-bd25d6d0-864a-47a1-b1bb-ab7e7b94821b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:34:59.403175 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bd25d6d0-864a-47a1-b1bb-ab7e7b94821b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:59.403620 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bd25d6d0-864a-47a1-b1bb-ab7e7b94821b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:59.404395 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bd25d6d0-864a-47a1-b1bb-ab7e7b94821b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:34:59.404821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-bd25d6d0-864a-47a1-b1bb-ab7e7b94821b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:34:59.496273 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-bd25d6d0-864a-47a1-b1bb-ab7e7b94821b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 22980 microversion: 2.1 time: 0.105233 Nov 12 02:34:59.497310 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 570/1107] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:34:59 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 22980 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:00.047952 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-878e0570-e23f-4397-8801-95e25475a163 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:00.048993 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-878e0570-e23f-4397-8801-95e25475a163 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:00.056016 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-878e0570-e23f-4397-8801-95e25475a163 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:00.056439 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-878e0570-e23f-4397-8801-95e25475a163 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:00.057233 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-878e0570-e23f-4397-8801-95e25475a163 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:00.057673 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-878e0570-e23f-4397-8801-95e25475a163 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:00.143199 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-878e0570-e23f-4397-8801-95e25475a163 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.099186 Nov 12 02:35:00.143867 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 538/1108] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:00 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:00.509555 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f44e1780-0d5e-4db8-add1-6b669f825efd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:00.510553 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f44e1780-0d5e-4db8-add1-6b669f825efd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:00.517518 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f44e1780-0d5e-4db8-add1-6b669f825efd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:00.517964 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f44e1780-0d5e-4db8-add1-6b669f825efd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:00.518783 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f44e1780-0d5e-4db8-add1-6b669f825efd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:00.519212 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f44e1780-0d5e-4db8-add1-6b669f825efd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:00.611204 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f44e1780-0d5e-4db8-add1-6b669f825efd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 23803 microversion: 2.1 time: 0.106024 Nov 12 02:35:00.612019 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 571/1109] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:00 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 23803 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:01.156275 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3eea5143-6aea-4645-909b-76491d78cd50 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:01.157289 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3eea5143-6aea-4645-909b-76491d78cd50 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:01.164921 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3eea5143-6aea-4645-909b-76491d78cd50 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:01.165375 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3eea5143-6aea-4645-909b-76491d78cd50 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:01.166177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3eea5143-6aea-4645-909b-76491d78cd50 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:01.166616 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3eea5143-6aea-4645-909b-76491d78cd50 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:01.263243 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3eea5143-6aea-4645-909b-76491d78cd50 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.110776 Nov 12 02:35:01.263908 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 539/1110] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:01 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:01.623080 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b63e8850-cb9c-4ebc-8db7-8530444a49ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:01.624083 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b63e8850-cb9c-4ebc-8db7-8530444a49ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:01.631720 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b63e8850-cb9c-4ebc-8db7-8530444a49ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:01.632171 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b63e8850-cb9c-4ebc-8db7-8530444a49ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:01.632956 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b63e8850-cb9c-4ebc-8db7-8530444a49ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:01.633392 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b63e8850-cb9c-4ebc-8db7-8530444a49ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:01.729692 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b63e8850-cb9c-4ebc-8db7-8530444a49ac tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 25440 microversion: 2.1 time: 0.110495 Nov 12 02:35:01.730343 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 572/1111] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:01 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 25440 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:02.278816 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-828fcf24-428c-4968-8795-d03a747d1417 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:02.280927 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-828fcf24-428c-4968-8795-d03a747d1417 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:02.288476 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-828fcf24-428c-4968-8795-d03a747d1417 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:02.288929 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-828fcf24-428c-4968-8795-d03a747d1417 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:02.289748 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-828fcf24-428c-4968-8795-d03a747d1417 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:02.290428 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-828fcf24-428c-4968-8795-d03a747d1417 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:02.380510 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-828fcf24-428c-4968-8795-d03a747d1417 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.108411 Nov 12 02:35:02.381471 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 540/1112] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:02 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:02.741807 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3248172a-c2d2-4642-a841-d108fb0551c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:02.743106 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3248172a-c2d2-4642-a841-d108fb0551c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:02.750223 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3248172a-c2d2-4642-a841-d108fb0551c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:02.750716 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3248172a-c2d2-4642-a841-d108fb0551c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:02.751498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3248172a-c2d2-4642-a841-d108fb0551c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:02.751929 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3248172a-c2d2-4642-a841-d108fb0551c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:02.846557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3248172a-c2d2-4642-a841-d108fb0551c4 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 26973 microversion: 2.1 time: 0.108641 Nov 12 02:35:02.847496 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 573/1113] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:02 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 26973 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:03.392994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c33da32d-7889-4fff-a32e-0c6bdcb3a15b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:03.394028 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c33da32d-7889-4fff-a32e-0c6bdcb3a15b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:03.401496 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c33da32d-7889-4fff-a32e-0c6bdcb3a15b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:03.401893 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c33da32d-7889-4fff-a32e-0c6bdcb3a15b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:03.402699 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c33da32d-7889-4fff-a32e-0c6bdcb3a15b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:03.403244 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c33da32d-7889-4fff-a32e-0c6bdcb3a15b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:03.493753 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c33da32d-7889-4fff-a32e-0c6bdcb3a15b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.104596 Nov 12 02:35:03.494750 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 541/1114] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:03 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:03.859595 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-48faa450-e981-4b85-8963-4544773f0c2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:03.860620 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-48faa450-e981-4b85-8963-4544773f0c2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:03.868566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-48faa450-e981-4b85-8963-4544773f0c2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:03.869013 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-48faa450-e981-4b85-8963-4544773f0c2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:03.869834 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-48faa450-e981-4b85-8963-4544773f0c2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:03.870300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-48faa450-e981-4b85-8963-4544773f0c2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:03.967299 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-48faa450-e981-4b85-8963-4544773f0c2f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 27661 microversion: 2.1 time: 0.111649 Nov 12 02:35:03.968190 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 574/1115] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:03 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 27661 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:04.506410 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1d1e36be-2f53-4af4-86c9-7c08b6d2640e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:04.507354 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1d1e36be-2f53-4af4-86c9-7c08b6d2640e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:04.514353 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d1e36be-2f53-4af4-86c9-7c08b6d2640e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:04.514834 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d1e36be-2f53-4af4-86c9-7c08b6d2640e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:04.515623 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d1e36be-2f53-4af4-86c9-7c08b6d2640e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:04.516058 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1d1e36be-2f53-4af4-86c9-7c08b6d2640e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:04.602010 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1d1e36be-2f53-4af4-86c9-7c08b6d2640e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.099589 Nov 12 02:35:04.602681 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 542/1116] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:04 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:04.983095 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fd18e4ec-255d-45fd-a419-1324c5cb7cde tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:04.984146 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-fd18e4ec-255d-45fd-a419-1324c5cb7cde tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:04.991050 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd18e4ec-255d-45fd-a419-1324c5cb7cde tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:04.991495 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd18e4ec-255d-45fd-a419-1324c5cb7cde tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:04.992533 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd18e4ec-255d-45fd-a419-1324c5cb7cde tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:04.992983 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd18e4ec-255d-45fd-a419-1324c5cb7cde tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:05.088083 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-fd18e4ec-255d-45fd-a419-1324c5cb7cde tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28023 microversion: 2.1 time: 0.111272 Nov 12 02:35:05.088735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 575/1117] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:04 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28023 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:05.614591 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cd78cefc-b535-46f7-bf89-98b77cf30415 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:05.615631 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cd78cefc-b535-46f7-bf89-98b77cf30415 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:05.622939 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd78cefc-b535-46f7-bf89-98b77cf30415 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:05.623392 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd78cefc-b535-46f7-bf89-98b77cf30415 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:05.624184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd78cefc-b535-46f7-bf89-98b77cf30415 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:05.624623 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd78cefc-b535-46f7-bf89-98b77cf30415 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:05.709556 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cd78cefc-b535-46f7-bf89-98b77cf30415 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.098385 Nov 12 02:35:05.710207 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 543/1118] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:05 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:06.100754 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ed97f4d7-cf66-47ea-874e-9b79362aeda8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:06.101779 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ed97f4d7-cf66-47ea-874e-9b79362aeda8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:06.108756 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ed97f4d7-cf66-47ea-874e-9b79362aeda8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:06.109201 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ed97f4d7-cf66-47ea-874e-9b79362aeda8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:06.109979 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ed97f4d7-cf66-47ea-874e-9b79362aeda8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:06.110411 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ed97f4d7-cf66-47ea-874e-9b79362aeda8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:06.202637 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ed97f4d7-cf66-47ea-874e-9b79362aeda8 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.105698 Nov 12 02:35:06.203498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 576/1119] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:06 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:06.721901 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-25f2cd94-08aa-42b7-80bf-de1cd4e2bca8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:06.722956 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-25f2cd94-08aa-42b7-80bf-de1cd4e2bca8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:06.729989 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-25f2cd94-08aa-42b7-80bf-de1cd4e2bca8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:06.730442 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-25f2cd94-08aa-42b7-80bf-de1cd4e2bca8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:06.731267 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-25f2cd94-08aa-42b7-80bf-de1cd4e2bca8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:06.731706 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-25f2cd94-08aa-42b7-80bf-de1cd4e2bca8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:06.828948 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-25f2cd94-08aa-42b7-80bf-de1cd4e2bca8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.110991 Nov 12 02:35:06.829625 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 544/1120] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:06 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:07.214106 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-620c2bbb-46b0-4036-b818-546037e39a3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:07.215137 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-620c2bbb-46b0-4036-b818-546037e39a3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:07.222046 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-620c2bbb-46b0-4036-b818-546037e39a3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:07.222498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-620c2bbb-46b0-4036-b818-546037e39a3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:07.223308 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-620c2bbb-46b0-4036-b818-546037e39a3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:07.223743 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-620c2bbb-46b0-4036-b818-546037e39a3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:07.315462 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-620c2bbb-46b0-4036-b818-546037e39a3e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.105236 Nov 12 02:35:07.316130 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 577/1121] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:07 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:07.841173 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-626a2b44-6f2a-40a0-a5aa-6e0735bb51d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:07.842202 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-626a2b44-6f2a-40a0-a5aa-6e0735bb51d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:07.849151 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-626a2b44-6f2a-40a0-a5aa-6e0735bb51d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:07.849592 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-626a2b44-6f2a-40a0-a5aa-6e0735bb51d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:07.850364 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-626a2b44-6f2a-40a0-a5aa-6e0735bb51d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:07.850828 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-626a2b44-6f2a-40a0-a5aa-6e0735bb51d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:07.939203 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-626a2b44-6f2a-40a0-a5aa-6e0735bb51d0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.101845 Nov 12 02:35:07.939906 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 545/1122] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:07 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:08.328811 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-733c7378-4def-4d0b-86ac-e703d6bb1863 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:08.329815 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-733c7378-4def-4d0b-86ac-e703d6bb1863 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:08.337925 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-733c7378-4def-4d0b-86ac-e703d6bb1863 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:08.339861 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-733c7378-4def-4d0b-86ac-e703d6bb1863 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:08.341763 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-733c7378-4def-4d0b-86ac-e703d6bb1863 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:08.342217 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-733c7378-4def-4d0b-86ac-e703d6bb1863 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:08.430621 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-733c7378-4def-4d0b-86ac-e703d6bb1863 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.105751 Nov 12 02:35:08.431308 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 578/1123] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:08 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:08.952063 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8f8ea0b7-e48d-4dad-83a8-38d7e0c7fbb2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:08.953057 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8f8ea0b7-e48d-4dad-83a8-38d7e0c7fbb2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:08.960141 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f8ea0b7-e48d-4dad-83a8-38d7e0c7fbb2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:08.960594 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f8ea0b7-e48d-4dad-83a8-38d7e0c7fbb2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:08.961386 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f8ea0b7-e48d-4dad-83a8-38d7e0c7fbb2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:08.961817 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8f8ea0b7-e48d-4dad-83a8-38d7e0c7fbb2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:09.046935 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8f8ea0b7-e48d-4dad-83a8-38d7e0c7fbb2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.098701 Nov 12 02:35:09.047595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 546/1124] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:08 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:09.441992 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fca1073a-f71b-4ae9-bcd8-4bb61896bdc6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:09.443016 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-fca1073a-f71b-4ae9-bcd8-4bb61896bdc6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:09.450736 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fca1073a-f71b-4ae9-bcd8-4bb61896bdc6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:09.451193 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fca1073a-f71b-4ae9-bcd8-4bb61896bdc6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:09.451984 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fca1073a-f71b-4ae9-bcd8-4bb61896bdc6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:09.452423 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fca1073a-f71b-4ae9-bcd8-4bb61896bdc6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:09.534936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-fca1073a-f71b-4ae9-bcd8-4bb61896bdc6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.096733 Nov 12 02:35:09.535847 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 579/1125] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:09 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:10.059991 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-180259a2-fef5-4908-a0d4-8e2044c95fe9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:10.060932 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-180259a2-fef5-4908-a0d4-8e2044c95fe9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:10.067819 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-180259a2-fef5-4908-a0d4-8e2044c95fe9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:10.068262 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-180259a2-fef5-4908-a0d4-8e2044c95fe9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:10.069035 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-180259a2-fef5-4908-a0d4-8e2044c95fe9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:10.070055 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-180259a2-fef5-4908-a0d4-8e2044c95fe9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:10.154452 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-180259a2-fef5-4908-a0d4-8e2044c95fe9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.098422 Nov 12 02:35:10.155138 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 547/1126] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:10 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:10.547661 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c783eebd-7568-418a-a797-cc5ce3137afa tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:10.548703 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c783eebd-7568-418a-a797-cc5ce3137afa tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:10.556250 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c783eebd-7568-418a-a797-cc5ce3137afa tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:10.556706 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c783eebd-7568-418a-a797-cc5ce3137afa tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:10.557505 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c783eebd-7568-418a-a797-cc5ce3137afa tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:10.557940 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c783eebd-7568-418a-a797-cc5ce3137afa tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:10.643257 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c783eebd-7568-418a-a797-cc5ce3137afa tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.099516 Nov 12 02:35:10.643912 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 580/1127] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:10 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:11.166128 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bcdd3777-1600-4cda-8d71-64a278967f17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:11.167159 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bcdd3777-1600-4cda-8d71-64a278967f17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:11.174078 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bcdd3777-1600-4cda-8d71-64a278967f17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:11.174531 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bcdd3777-1600-4cda-8d71-64a278967f17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:11.175343 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bcdd3777-1600-4cda-8d71-64a278967f17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:11.175778 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bcdd3777-1600-4cda-8d71-64a278967f17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:11.264413 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bcdd3777-1600-4cda-8d71-64a278967f17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.102155 Nov 12 02:35:11.265133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 548/1128] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:11 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:11.656585 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3848862f-bb07-4995-ad71-7a0689baa517 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:11.657665 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3848862f-bb07-4995-ad71-7a0689baa517 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:11.668352 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3848862f-bb07-4995-ad71-7a0689baa517 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:11.668790 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3848862f-bb07-4995-ad71-7a0689baa517 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:11.669581 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3848862f-bb07-4995-ad71-7a0689baa517 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:11.670002 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3848862f-bb07-4995-ad71-7a0689baa517 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:11.760467 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3848862f-bb07-4995-ad71-7a0689baa517 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.107875 Nov 12 02:35:11.761127 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 581/1129] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:11 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:12.276903 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-592f18a7-335e-424e-8994-c2e07bb0bd65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:12.278397 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-592f18a7-335e-424e-8994-c2e07bb0bd65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:12.285362 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-592f18a7-335e-424e-8994-c2e07bb0bd65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:12.285819 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-592f18a7-335e-424e-8994-c2e07bb0bd65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:12.286604 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-592f18a7-335e-424e-8994-c2e07bb0bd65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:12.287071 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-592f18a7-335e-424e-8994-c2e07bb0bd65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:12.372589 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-592f18a7-335e-424e-8994-c2e07bb0bd65 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.100293 Nov 12 02:35:12.373247 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 549/1130] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:12 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:12.773797 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b39fa441-e722-46a1-a8c7-9c2931fafe95 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:12.774828 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b39fa441-e722-46a1-a8c7-9c2931fafe95 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:12.781869 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b39fa441-e722-46a1-a8c7-9c2931fafe95 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:12.782320 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b39fa441-e722-46a1-a8c7-9c2931fafe95 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:12.783142 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b39fa441-e722-46a1-a8c7-9c2931fafe95 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:12.783589 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b39fa441-e722-46a1-a8c7-9c2931fafe95 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:12.865691 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b39fa441-e722-46a1-a8c7-9c2931fafe95 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.096446 Nov 12 02:35:12.866628 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 582/1131] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:12 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:13.384640 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4b885c72-c367-4b3e-a0d9-1fa5b0168f4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:13.385634 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4b885c72-c367-4b3e-a0d9-1fa5b0168f4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:13.392445 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4b885c72-c367-4b3e-a0d9-1fa5b0168f4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:13.392886 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4b885c72-c367-4b3e-a0d9-1fa5b0168f4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:13.393655 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4b885c72-c367-4b3e-a0d9-1fa5b0168f4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:13.394083 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4b885c72-c367-4b3e-a0d9-1fa5b0168f4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:13.482537 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4b885c72-c367-4b3e-a0d9-1fa5b0168f4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.102358 Nov 12 02:35:13.483144 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 550/1132] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:13 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:13.877949 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b3ff6665-2944-45ba-9650-f0f9200d5673 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:13.879068 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b3ff6665-2944-45ba-9650-f0f9200d5673 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:13.886465 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b3ff6665-2944-45ba-9650-f0f9200d5673 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:13.886936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b3ff6665-2944-45ba-9650-f0f9200d5673 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:13.887743 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b3ff6665-2944-45ba-9650-f0f9200d5673 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:13.888175 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b3ff6665-2944-45ba-9650-f0f9200d5673 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:13.999910 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b3ff6665-2944-45ba-9650-f0f9200d5673 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.125777 Nov 12 02:35:14.001334 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 583/1133] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:13 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:14.496235 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b924b2f0-bc48-49c1-9b3a-e3d8b8dd2374 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:14.497231 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b924b2f0-bc48-49c1-9b3a-e3d8b8dd2374 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:14.504139 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b924b2f0-bc48-49c1-9b3a-e3d8b8dd2374 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:14.504596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b924b2f0-bc48-49c1-9b3a-e3d8b8dd2374 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:14.505376 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b924b2f0-bc48-49c1-9b3a-e3d8b8dd2374 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:14.505806 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b924b2f0-bc48-49c1-9b3a-e3d8b8dd2374 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:14.589818 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b924b2f0-bc48-49c1-9b3a-e3d8b8dd2374 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.097859 Nov 12 02:35:14.590468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 551/1134] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:14 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:15.015003 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-df9c78b8-3b1a-496a-a29c-63a1e8d9cfa2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:15.016019 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-df9c78b8-3b1a-496a-a29c-63a1e8d9cfa2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:15.023647 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-df9c78b8-3b1a-496a-a29c-63a1e8d9cfa2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:15.024091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-df9c78b8-3b1a-496a-a29c-63a1e8d9cfa2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:15.024869 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-df9c78b8-3b1a-496a-a29c-63a1e8d9cfa2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:15.025296 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-df9c78b8-3b1a-496a-a29c-63a1e8d9cfa2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:15.107682 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-df9c78b8-3b1a-496a-a29c-63a1e8d9cfa2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.098814 Nov 12 02:35:15.109162 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 584/1135] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:15 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:15.602160 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4572ecb0-b114-44f7-acba-e2c35c2951c4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:15.603187 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4572ecb0-b114-44f7-acba-e2c35c2951c4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:15.610193 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4572ecb0-b114-44f7-acba-e2c35c2951c4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:15.610642 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4572ecb0-b114-44f7-acba-e2c35c2951c4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:15.611450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4572ecb0-b114-44f7-acba-e2c35c2951c4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:15.611887 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4572ecb0-b114-44f7-acba-e2c35c2951c4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:15.696678 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4572ecb0-b114-44f7-acba-e2c35c2951c4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.099020 Nov 12 02:35:15.697335 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 552/1136] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:15 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:16.120830 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7da5aa5e-a32e-42b8-b675-a98a038407ba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:16.121839 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7da5aa5e-a32e-42b8-b675-a98a038407ba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:16.128810 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7da5aa5e-a32e-42b8-b675-a98a038407ba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:16.129259 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7da5aa5e-a32e-42b8-b675-a98a038407ba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:16.130039 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7da5aa5e-a32e-42b8-b675-a98a038407ba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:16.130473 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7da5aa5e-a32e-42b8-b675-a98a038407ba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:16.216697 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7da5aa5e-a32e-42b8-b675-a98a038407ba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.100455 Nov 12 02:35:16.217936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 585/1137] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:16 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:16.708882 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f0c117f5-05c6-490d-a6b1-720fa50e440b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:16.710496 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f0c117f5-05c6-490d-a6b1-720fa50e440b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:16.717648 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f0c117f5-05c6-490d-a6b1-720fa50e440b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:16.718106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f0c117f5-05c6-490d-a6b1-720fa50e440b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:16.718935 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f0c117f5-05c6-490d-a6b1-720fa50e440b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:16.719379 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f0c117f5-05c6-490d-a6b1-720fa50e440b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:16.812784 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f0c117f5-05c6-490d-a6b1-720fa50e440b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.107923 Nov 12 02:35:16.813445 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 553/1138] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:16 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:17.228185 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a88c18a1-639d-487b-bba7-4045b913e9ce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:17.229185 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a88c18a1-639d-487b-bba7-4045b913e9ce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:17.237658 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a88c18a1-639d-487b-bba7-4045b913e9ce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:17.237658 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a88c18a1-639d-487b-bba7-4045b913e9ce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:17.237959 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a88c18a1-639d-487b-bba7-4045b913e9ce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:17.238261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a88c18a1-639d-487b-bba7-4045b913e9ce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:17.322909 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a88c18a1-639d-487b-bba7-4045b913e9ce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.098561 Nov 12 02:35:17.324734 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 586/1139] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:17 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:17.825745 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-70987e63-1723-437d-87d6-31a37e2ea5b8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:17.826763 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-70987e63-1723-437d-87d6-31a37e2ea5b8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:17.833668 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-70987e63-1723-437d-87d6-31a37e2ea5b8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:17.834108 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-70987e63-1723-437d-87d6-31a37e2ea5b8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:17.834940 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-70987e63-1723-437d-87d6-31a37e2ea5b8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:17.835368 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-70987e63-1723-437d-87d6-31a37e2ea5b8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:17.926146 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-70987e63-1723-437d-87d6-31a37e2ea5b8 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.104343 Nov 12 02:35:17.926828 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 554/1140] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:17 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:18.336713 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9a352459-7ef3-4283-9a0b-2d4863e9ee02 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:18.337867 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9a352459-7ef3-4283-9a0b-2d4863e9ee02 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:18.344823 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9a352459-7ef3-4283-9a0b-2d4863e9ee02 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:18.345272 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9a352459-7ef3-4283-9a0b-2d4863e9ee02 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:18.346060 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9a352459-7ef3-4283-9a0b-2d4863e9ee02 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:18.346494 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9a352459-7ef3-4283-9a0b-2d4863e9ee02 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:18.939807 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7b222e0b-1721-4de4-af6d-beeeebdf5c0f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:18.940806 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7b222e0b-1721-4de4-af6d-beeeebdf5c0f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:18.947397 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7b222e0b-1721-4de4-af6d-beeeebdf5c0f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:18.947851 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7b222e0b-1721-4de4-af6d-beeeebdf5c0f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:18.948642 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7b222e0b-1721-4de4-af6d-beeeebdf5c0f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:18.949115 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7b222e0b-1721-4de4-af6d-beeeebdf5c0f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:21.602342 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9a352459-7ef3-4283-9a0b-2d4863e9ee02 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 3.270122 Nov 12 02:35:21.603032 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 587/1141] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:18 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 3272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:21.630939 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7b222e0b-1721-4de4-af6d-beeeebdf5c0f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 2.696673 Nov 12 02:35:21.632395 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 555/1142] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:18 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 2699 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:35:22.614593 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e7be434f-9ee1-4805-ba8c-dc49b7da51fc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:22.616530 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e7be434f-9ee1-4805-ba8c-dc49b7da51fc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:22.626042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e7be434f-9ee1-4805-ba8c-dc49b7da51fc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:22.626840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e7be434f-9ee1-4805-ba8c-dc49b7da51fc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:22.627633 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e7be434f-9ee1-4805-ba8c-dc49b7da51fc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:22.628129 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e7be434f-9ee1-4805-ba8c-dc49b7da51fc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:22.643741 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5e64bb16-7c1a-433e-988e-eae808617173 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:22.645397 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5e64bb16-7c1a-433e-988e-eae808617173 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:22.655483 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e64bb16-7c1a-433e-988e-eae808617173 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:22.656204 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e64bb16-7c1a-433e-988e-eae808617173 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:22.657200 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e64bb16-7c1a-433e-988e-eae808617173 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:22.657638 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e64bb16-7c1a-433e-988e-eae808617173 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:22.734553 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e7be434f-9ee1-4805-ba8c-dc49b7da51fc tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.123756 Nov 12 02:35:22.735324 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 588/1143] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:22 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:22.765583 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5e64bb16-7c1a-433e-988e-eae808617173 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.125784 Nov 12 02:35:22.766585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 556/1144] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:22 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:35:23.748589 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-11ac9f15-ebf9-4931-a845-a7b61ef7c570 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:23.749592 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-11ac9f15-ebf9-4931-a845-a7b61ef7c570 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:23.757255 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-11ac9f15-ebf9-4931-a845-a7b61ef7c570 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:23.757661 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-11ac9f15-ebf9-4931-a845-a7b61ef7c570 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:23.758445 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-11ac9f15-ebf9-4931-a845-a7b61ef7c570 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:23.758909 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-11ac9f15-ebf9-4931-a845-a7b61ef7c570 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:23.778253 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e3a31515-b2c5-4f0d-9aa6-c257d4b51c17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:23.780358 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e3a31515-b2c5-4f0d-9aa6-c257d4b51c17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:23.788277 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e3a31515-b2c5-4f0d-9aa6-c257d4b51c17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:23.788764 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e3a31515-b2c5-4f0d-9aa6-c257d4b51c17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:23.789585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e3a31515-b2c5-4f0d-9aa6-c257d4b51c17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:23.790013 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e3a31515-b2c5-4f0d-9aa6-c257d4b51c17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:23.900826 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-11ac9f15-ebf9-4931-a845-a7b61ef7c570 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.156200 Nov 12 02:35:23.901478 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 589/1145] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:23 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:23.921981 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e3a31515-b2c5-4f0d-9aa6-c257d4b51c17 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.147940 Nov 12 02:35:23.922634 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 557/1146] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:23 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:35:24.913488 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7b2acadf-fd02-4a8f-8c7a-0dcf11449df7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:24.914606 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7b2acadf-fd02-4a8f-8c7a-0dcf11449df7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:24.921500 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b2acadf-fd02-4a8f-8c7a-0dcf11449df7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:24.921942 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b2acadf-fd02-4a8f-8c7a-0dcf11449df7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:24.922737 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b2acadf-fd02-4a8f-8c7a-0dcf11449df7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:24.923170 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7b2acadf-fd02-4a8f-8c7a-0dcf11449df7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:24.933987 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1539c034-2688-4c51-9c30-a8f79cdbf8a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:24.935021 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1539c034-2688-4c51-9c30-a8f79cdbf8a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:24.941966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1539c034-2688-4c51-9c30-a8f79cdbf8a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:24.942419 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1539c034-2688-4c51-9c30-a8f79cdbf8a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:24.943245 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1539c034-2688-4c51-9c30-a8f79cdbf8a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:24.944207 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1539c034-2688-4c51-9c30-a8f79cdbf8a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:25.024837 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7b2acadf-fd02-4a8f-8c7a-0dcf11449df7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.115701 Nov 12 02:35:25.025497 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 590/1147] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:24 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:25.052636 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1539c034-2688-4c51-9c30-a8f79cdbf8a4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.122539 Nov 12 02:35:25.053921 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 558/1148] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:24 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:35:26.039576 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d774bf20-74dc-440d-a52c-985866773c18 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:26.040478 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d774bf20-74dc-440d-a52c-985866773c18 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:26.048084 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d774bf20-74dc-440d-a52c-985866773c18 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:26.048566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d774bf20-74dc-440d-a52c-985866773c18 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:26.049305 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d774bf20-74dc-440d-a52c-985866773c18 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:26.049740 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d774bf20-74dc-440d-a52c-985866773c18 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:26.064854 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e201c7f7-355e-4ffa-9063-189a4c0ec699 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:26.066373 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e201c7f7-355e-4ffa-9063-189a4c0ec699 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:26.073280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e201c7f7-355e-4ffa-9063-189a4c0ec699 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:26.073831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e201c7f7-355e-4ffa-9063-189a4c0ec699 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:26.074720 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e201c7f7-355e-4ffa-9063-189a4c0ec699 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:26.075164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e201c7f7-355e-4ffa-9063-189a4c0ec699 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:26.153190 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d774bf20-74dc-440d-a52c-985866773c18 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.119809 Nov 12 02:35:26.153877 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 591/1149] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:26 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:35:26.195167 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e201c7f7-355e-4ffa-9063-189a4c0ec699 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.134283 Nov 12 02:35:26.196073 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 559/1150] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:26 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:27.166225 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-41ea9e52-f8f1-4052-b15f-d23327a4e5d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:27.167374 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-41ea9e52-f8f1-4052-b15f-d23327a4e5d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:27.174542 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-41ea9e52-f8f1-4052-b15f-d23327a4e5d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:27.175064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-41ea9e52-f8f1-4052-b15f-d23327a4e5d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:27.175831 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-41ea9e52-f8f1-4052-b15f-d23327a4e5d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:27.176264 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-41ea9e52-f8f1-4052-b15f-d23327a4e5d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:27.207728 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4afd98f1-22a6-4507-9cca-dd4a2c921c31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:27.208719 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4afd98f1-22a6-4507-9cca-dd4a2c921c31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:27.216754 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4afd98f1-22a6-4507-9cca-dd4a2c921c31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:27.217198 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4afd98f1-22a6-4507-9cca-dd4a2c921c31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:27.218085 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4afd98f1-22a6-4507-9cca-dd4a2c921c31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:27.218611 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4afd98f1-22a6-4507-9cca-dd4a2c921c31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:27.260790 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-41ea9e52-f8f1-4052-b15f-d23327a4e5d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.099036 Nov 12 02:35:27.261707 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 592/1151] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:27 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:27.311303 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4afd98f1-22a6-4507-9cca-dd4a2c921c31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.107903 Nov 12 02:35:27.311987 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 560/1152] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:27 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:35:28.272611 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f630e21c-bf7f-4069-9b33-f7aa0ced48e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:28.273653 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f630e21c-bf7f-4069-9b33-f7aa0ced48e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:28.280638 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f630e21c-bf7f-4069-9b33-f7aa0ced48e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:28.281091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f630e21c-bf7f-4069-9b33-f7aa0ced48e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:28.281882 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f630e21c-bf7f-4069-9b33-f7aa0ced48e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:28.282318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f630e21c-bf7f-4069-9b33-f7aa0ced48e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:28.323485 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-187566d9-a9cb-4df8-be90-4540066adce1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:28.324481 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-187566d9-a9cb-4df8-be90-4540066adce1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:28.331352 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-187566d9-a9cb-4df8-be90-4540066adce1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:28.331799 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-187566d9-a9cb-4df8-be90-4540066adce1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:28.332575 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-187566d9-a9cb-4df8-be90-4540066adce1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:28.333012 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-187566d9-a9cb-4df8-be90-4540066adce1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:28.370064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f630e21c-bf7f-4069-9b33-f7aa0ced48e7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.101304 Nov 12 02:35:28.370812 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 593/1153] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:28 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:28.422068 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-187566d9-a9cb-4df8-be90-4540066adce1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.103007 Nov 12 02:35:28.422753 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 561/1154] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:28 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:35:29.382411 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fb25272d-671e-4ebf-bb15-965ca1cd1c5b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:29.383435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-fb25272d-671e-4ebf-bb15-965ca1cd1c5b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:29.390233 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fb25272d-671e-4ebf-bb15-965ca1cd1c5b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:29.390710 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fb25272d-671e-4ebf-bb15-965ca1cd1c5b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:29.391490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fb25272d-671e-4ebf-bb15-965ca1cd1c5b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:29.391926 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fb25272d-671e-4ebf-bb15-965ca1cd1c5b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:29.435656 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1fa23d70-8b3d-4782-a6f3-676dd3cc4b0d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:29.436564 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1fa23d70-8b3d-4782-a6f3-676dd3cc4b0d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:29.443510 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fa23d70-8b3d-4782-a6f3-676dd3cc4b0d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:29.443967 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fa23d70-8b3d-4782-a6f3-676dd3cc4b0d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:29.444753 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fa23d70-8b3d-4782-a6f3-676dd3cc4b0d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:29.445191 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fa23d70-8b3d-4782-a6f3-676dd3cc4b0d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:29.542601 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-fb25272d-671e-4ebf-bb15-965ca1cd1c5b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.164126 Nov 12 02:35:29.543300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 594/1155] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:29 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:29.593472 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1fa23d70-8b3d-4782-a6f3-676dd3cc4b0d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 28634 microversion: 2.20 time: 0.161852 Nov 12 02:35:29.594376 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 562/1156] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:29 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 28634 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:30.355250 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1036424256", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1761431138", "security_groups": [{"name": "tempest-secgroup-smoke-677549840"}], "block_device_mapping_v2": [{"uuid": "762df5b2-569b-4156-99ea-ebeeb7d44ad7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "987f135b-2ece-4383-9fb9-ce7b7e8f8bd1"}]}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:30.470310 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.network.neutron [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] validate_networks() for [('987f135b-2ece-4383-9fb9-ce7b7e8f8bd1', None, None, None, None, None)] {{(pid=116099) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:35:30.555192 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9effa546-21a5-4b16-8cf3-e1540c84b8a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:30.556389 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9effa546-21a5-4b16-8cf3-e1540c84b8a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:30.563415 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9effa546-21a5-4b16-8cf3-e1540c84b8a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:30.563869 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9effa546-21a5-4b16-8cf3-e1540c84b8a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:30.564660 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9effa546-21a5-4b16-8cf3-e1540c84b8a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:30.565106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9effa546-21a5-4b16-8cf3-e1540c84b8a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:30.649050 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9effa546-21a5-4b16-8cf3-e1540c84b8a2 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28207 microversion: 2.1 time: 0.097658 Nov 12 02:35:30.653031 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 563/1157] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:30 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28207 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:35:30.654869 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-217d3383-9fbf-497a-a56e-e63e3eec5d43 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:30.655842 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-217d3383-9fbf-497a-a56e-e63e3eec5d43 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:30.662767 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-217d3383-9fbf-497a-a56e-e63e3eec5d43 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:30.663212 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-217d3383-9fbf-497a-a56e-e63e3eec5d43 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:30.663998 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-217d3383-9fbf-497a-a56e-e63e3eec5d43 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:30.664449 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-217d3383-9fbf-497a-a56e-e63e3eec5d43 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:30.769867 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-217d3383-9fbf-497a-a56e-e63e3eec5d43 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 29785 microversion: 2.20 time: 0.118694 Nov 12 02:35:30.770798 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 564/1158] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:30 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 29785 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:30.873980 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Flavor limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:35:30.874406 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Image limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:35:30.874914 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Flavor pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:35:30.875327 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Image pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:35:30.875735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:35:30.886626 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:30.890728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:30.890728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:30.890728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:30.906143 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Getting quotas for project cdddbe78d48c4a9995c9d3e6c06bec3d. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:35:30.909998 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Getting quotas for user e5cae9ebcf844041b45c03bfd1fddcf6 and project cdddbe78d48c4a9995c9d3e6c06bec3d. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:35:30.965691 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Going to run 1 instances... {{(pid=116099) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:35:30.968303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='762df5b2-569b-4156-99ea-ebeeb7d44ad7',volume_size=None,volume_type=None)] {{(pid=116099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:35:31.107738 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-41add43f-60cc-4db8-affb-3bcd2fe48ad9 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.756449 Nov 12 02:35:31.108389 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 595/1159] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:35:30 2021] POST /compute/v2.1/servers => generated 405 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:35:31.119567 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6009bb38-7594-4672-abe8-341583cefa6c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:31.120272 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6009bb38-7594-4672-abe8-341583cefa6c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:31.210933 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6009bb38-7594-4672-abe8-341583cefa6c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:31.217765 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6009bb38-7594-4672-abe8-341583cefa6c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1095 microversion: 2.1 time: 0.102892 Nov 12 02:35:31.218351 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 565/1160] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:31 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:31.664042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9c3f9347-0a3d-4615-8e3a-0c64fac65eb5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:31.665647 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9c3f9347-0a3d-4615-8e3a-0c64fac65eb5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:31.679611 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9c3f9347-0a3d-4615-8e3a-0c64fac65eb5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:31.680055 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9c3f9347-0a3d-4615-8e3a-0c64fac65eb5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:31.680850 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9c3f9347-0a3d-4615-8e3a-0c64fac65eb5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:31.681278 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9c3f9347-0a3d-4615-8e3a-0c64fac65eb5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:31.781668 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b46f0cde-6b46-4a0a-889f-b31693ba3846 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:31.782899 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b46f0cde-6b46-4a0a-889f-b31693ba3846 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:31.789758 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9c3f9347-0a3d-4615-8e3a-0c64fac65eb5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28498 microversion: 2.1 time: 0.131851 Nov 12 02:35:31.792229 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 596/1161] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:31 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28498 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:31.792418 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b46f0cde-6b46-4a0a-889f-b31693ba3846 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:31.792536 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b46f0cde-6b46-4a0a-889f-b31693ba3846 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:31.793289 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b46f0cde-6b46-4a0a-889f-b31693ba3846 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:31.793911 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b46f0cde-6b46-4a0a-889f-b31693ba3846 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:31.895242 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b46f0cde-6b46-4a0a-889f-b31693ba3846 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 31868 microversion: 2.20 time: 0.117159 Nov 12 02:35:31.895901 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 566/1162] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:31 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 31868 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:35:32.237819 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7e938a2e-2aa0-4d52-8eb1-159013d38892 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:32.238437 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7e938a2e-2aa0-4d52-8eb1-159013d38892 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:32.245806 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7e938a2e-2aa0-4d52-8eb1-159013d38892 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:32.246252 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7e938a2e-2aa0-4d52-8eb1-159013d38892 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:32.247064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7e938a2e-2aa0-4d52-8eb1-159013d38892 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:32.247487 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7e938a2e-2aa0-4d52-8eb1-159013d38892 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:32.353149 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7e938a2e-2aa0-4d52-8eb1-159013d38892 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:32.363600 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7e938a2e-2aa0-4d52-8eb1-159013d38892 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1201 microversion: 2.1 time: 0.129829 Nov 12 02:35:32.374081 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 597/1163] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:32 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1201 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:32.806600 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5e053408-12f8-423e-b491-58b6c0aed7bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:32.807815 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5e053408-12f8-423e-b491-58b6c0aed7bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:32.814591 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e053408-12f8-423e-b491-58b6c0aed7bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:32.815066 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e053408-12f8-423e-b491-58b6c0aed7bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:32.815848 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e053408-12f8-423e-b491-58b6c0aed7bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:32.816280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5e053408-12f8-423e-b491-58b6c0aed7bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:32.907606 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-dc1d5a20-c9a2-4c3e-92d5-e02bbca71fef tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:32.908549 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-dc1d5a20-c9a2-4c3e-92d5-e02bbca71fef tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:32.909843 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5e053408-12f8-423e-b491-58b6c0aed7bd tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28498 microversion: 2.1 time: 0.111203 Nov 12 02:35:32.915273 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 567/1164] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:32 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28498 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:32.915843 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dc1d5a20-c9a2-4c3e-92d5-e02bbca71fef tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:32.916295 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dc1d5a20-c9a2-4c3e-92d5-e02bbca71fef tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:32.917079 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dc1d5a20-c9a2-4c3e-92d5-e02bbca71fef tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:32.917511 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dc1d5a20-c9a2-4c3e-92d5-e02bbca71fef tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:33.026721 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-dc1d5a20-c9a2-4c3e-92d5-e02bbca71fef tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 33228 microversion: 2.20 time: 0.122466 Nov 12 02:35:33.027622 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 598/1165] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:32 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 33228 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:35:33.380957 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-82942844-d6f1-4d61-bfff-a5eb84d36813 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:33.381986 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-82942844-d6f1-4d61-bfff-a5eb84d36813 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:33.389167 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82942844-d6f1-4d61-bfff-a5eb84d36813 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:33.389617 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82942844-d6f1-4d61-bfff-a5eb84d36813 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:33.390417 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82942844-d6f1-4d61-bfff-a5eb84d36813 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:33.390885 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82942844-d6f1-4d61-bfff-a5eb84d36813 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:33.607012 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-82942844-d6f1-4d61-bfff-a5eb84d36813 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:33.614492 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-82942844-d6f1-4d61-bfff-a5eb84d36813 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1266 microversion: 2.1 time: 0.237637 Nov 12 02:35:33.615147 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 568/1166] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:33 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:33.910091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-5dee0a84-6d44-4f9a-9597-71534492973a req-2f9f5049-9b0f-47af-b935-6c396241294f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83a6744-71fc-40f8-b0f5-7fbf936ddaea", "tag": "485ec9f6-9b65-4fdd-93d9-7e0ef9c14d71"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:33.911858 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:35:33.911858 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:35:33.923179 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-82498cb9-5f2d-4c68-a7ef-4fce87cf2827 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:33.924038 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-82498cb9-5f2d-4c68-a7ef-4fce87cf2827 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:33.938376 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82498cb9-5f2d-4c68-a7ef-4fce87cf2827 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:33.938858 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82498cb9-5f2d-4c68-a7ef-4fce87cf2827 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:33.939869 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82498cb9-5f2d-4c68-a7ef-4fce87cf2827 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:33.940311 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-82498cb9-5f2d-4c68-a7ef-4fce87cf2827 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:33.944000 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-5dee0a84-6d44-4f9a-9597-71534492973a req-2f9f5049-9b0f-47af-b935-6c396241294f service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:33.944445 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-5dee0a84-6d44-4f9a-9597-71534492973a req-2f9f5049-9b0f-47af-b935-6c396241294f service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:33.970636 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-5dee0a84-6d44-4f9a-9597-71534492973a req-2f9f5049-9b0f-47af-b935-6c396241294f service nova] Creating event network-changed:485ec9f6-9b65-4fdd-93d9-7e0ef9c14d71 for instance b83a6744-71fc-40f8-b0f5-7fbf936ddaea on hv-cinder-80857 Nov 12 02:35:33.978127 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-5dee0a84-6d44-4f9a-9597-71534492973a req-2f9f5049-9b0f-47af-b935-6c396241294f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073916 Nov 12 02:35:33.981500 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 599/1167] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:35:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:35:34.042614 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-755b711c-04fd-4783-8e07-c9cad915ac5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:34.043735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-755b711c-04fd-4783-8e07-c9cad915ac5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:34.050239 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-755b711c-04fd-4783-8e07-c9cad915ac5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:34.051098 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-755b711c-04fd-4783-8e07-c9cad915ac5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:34.051898 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-755b711c-04fd-4783-8e07-c9cad915ac5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:34.052505 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-755b711c-04fd-4783-8e07-c9cad915ac5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:34.079632 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-82498cb9-5f2d-4c68-a7ef-4fce87cf2827 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.160776 Nov 12 02:35:34.080300 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 569/1168] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:33 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:34.157263 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-755b711c-04fd-4783-8e07-c9cad915ac5c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 34084 microversion: 2.20 time: 0.119138 Nov 12 02:35:34.157944 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 600/1169] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:34 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 34084 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:35:34.632487 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4715c1e5-76da-4c81-8cee-0db8d40e60b7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:34.633187 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4715c1e5-76da-4c81-8cee-0db8d40e60b7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:34.640587 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4715c1e5-76da-4c81-8cee-0db8d40e60b7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:34.641065 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4715c1e5-76da-4c81-8cee-0db8d40e60b7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:34.641863 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4715c1e5-76da-4c81-8cee-0db8d40e60b7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:34.642303 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4715c1e5-76da-4c81-8cee-0db8d40e60b7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:34.881994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4715c1e5-76da-4c81-8cee-0db8d40e60b7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:34.889554 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4715c1e5-76da-4c81-8cee-0db8d40e60b7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1266 microversion: 2.1 time: 0.261084 Nov 12 02:35:34.890142 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 570/1170] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:34 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:35.092078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ee14801a-aaec-4b56-80e5-c6b314ff119b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:35.093064 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ee14801a-aaec-4b56-80e5-c6b314ff119b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:35.101486 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ee14801a-aaec-4b56-80e5-c6b314ff119b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:35.102112 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ee14801a-aaec-4b56-80e5-c6b314ff119b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:35.102936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ee14801a-aaec-4b56-80e5-c6b314ff119b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:35.103368 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ee14801a-aaec-4b56-80e5-c6b314ff119b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:35.172977 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9c68f031-4238-48b5-8a8e-00b7f9c32a7c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:35.174559 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9c68f031-4238-48b5-8a8e-00b7f9c32a7c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:35.183611 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c68f031-4238-48b5-8a8e-00b7f9c32a7c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:35.184203 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c68f031-4238-48b5-8a8e-00b7f9c32a7c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:35.185018 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c68f031-4238-48b5-8a8e-00b7f9c32a7c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:35.185450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c68f031-4238-48b5-8a8e-00b7f9c32a7c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:35.281509 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9c68f031-4238-48b5-8a8e-00b7f9c32a7c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 35368 microversion: 2.20 time: 0.115214 Nov 12 02:35:35.282548 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 571/1171] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:35 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 35368 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:35:35.501209 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ee14801a-aaec-4b56-80e5-c6b314ff119b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.413229 Nov 12 02:35:35.501957 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 601/1172] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:35 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:35.907730 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f8341f82-ce24-4ae2-99b6-7000dc23a2c7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:35.908409 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f8341f82-ce24-4ae2-99b6-7000dc23a2c7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:35.915983 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f8341f82-ce24-4ae2-99b6-7000dc23a2c7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:35.916429 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f8341f82-ce24-4ae2-99b6-7000dc23a2c7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:35.917210 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f8341f82-ce24-4ae2-99b6-7000dc23a2c7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:35.917637 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f8341f82-ce24-4ae2-99b6-7000dc23a2c7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:36.072566 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f8341f82-ce24-4ae2-99b6-7000dc23a2c7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:36.080270 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f8341f82-ce24-4ae2-99b6-7000dc23a2c7 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1266 microversion: 2.1 time: 0.176518 Nov 12 02:35:36.080844 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 572/1173] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:35 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:36.295000 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-716baf98-48b9-4a58-bc65-a332dcedee9a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:36.295992 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-716baf98-48b9-4a58-bc65-a332dcedee9a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:36.303116 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-716baf98-48b9-4a58-bc65-a332dcedee9a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:36.303572 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-716baf98-48b9-4a58-bc65-a332dcedee9a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:36.304363 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-716baf98-48b9-4a58-bc65-a332dcedee9a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:36.304802 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-716baf98-48b9-4a58-bc65-a332dcedee9a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:36.402042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-716baf98-48b9-4a58-bc65-a332dcedee9a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 36429 microversion: 2.20 time: 0.111098 Nov 12 02:35:36.402701 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 602/1174] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:36 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 36429 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:36.513025 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ffcac26d-81d8-4a59-b256-df6155bb56a5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:36.513978 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ffcac26d-81d8-4a59-b256-df6155bb56a5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:36.520711 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ffcac26d-81d8-4a59-b256-df6155bb56a5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:36.521158 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ffcac26d-81d8-4a59-b256-df6155bb56a5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:36.522466 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ffcac26d-81d8-4a59-b256-df6155bb56a5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:36.522935 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ffcac26d-81d8-4a59-b256-df6155bb56a5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:36.612781 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ffcac26d-81d8-4a59-b256-df6155bb56a5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.102770 Nov 12 02:35:36.613981 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 573/1175] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:36 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:37.098787 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-152e8563-7ccf-4401-970b-6e4ce40c9419 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:37.099515 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-152e8563-7ccf-4401-970b-6e4ce40c9419 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:37.106426 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-152e8563-7ccf-4401-970b-6e4ce40c9419 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:37.106905 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-152e8563-7ccf-4401-970b-6e4ce40c9419 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:37.107687 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-152e8563-7ccf-4401-970b-6e4ce40c9419 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:37.108117 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-152e8563-7ccf-4401-970b-6e4ce40c9419 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:37.253241 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-152e8563-7ccf-4401-970b-6e4ce40c9419 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:37.261903 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-152e8563-7ccf-4401-970b-6e4ce40c9419 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1266 microversion: 2.1 time: 0.167325 Nov 12 02:35:37.262471 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 603/1176] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:37 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:37.415441 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cdd49c06-937c-4d0b-b0be-6ddb02fa4322 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:37.416437 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cdd49c06-937c-4d0b-b0be-6ddb02fa4322 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:37.423474 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cdd49c06-937c-4d0b-b0be-6ddb02fa4322 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:37.423927 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cdd49c06-937c-4d0b-b0be-6ddb02fa4322 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:37.424711 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cdd49c06-937c-4d0b-b0be-6ddb02fa4322 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:37.425145 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cdd49c06-937c-4d0b-b0be-6ddb02fa4322 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:37.529991 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cdd49c06-937c-4d0b-b0be-6ddb02fa4322 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 37973 microversion: 2.20 time: 0.118741 Nov 12 02:35:37.531185 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 574/1177] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:37 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 37973 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:37.625428 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b7cdac0e-e5f5-4f52-8f22-e06632ef35a0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:37.626353 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b7cdac0e-e5f5-4f52-8f22-e06632ef35a0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:37.632891 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b7cdac0e-e5f5-4f52-8f22-e06632ef35a0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:37.633342 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b7cdac0e-e5f5-4f52-8f22-e06632ef35a0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:37.634182 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b7cdac0e-e5f5-4f52-8f22-e06632ef35a0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:37.634620 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b7cdac0e-e5f5-4f52-8f22-e06632ef35a0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:37.723569 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b7cdac0e-e5f5-4f52-8f22-e06632ef35a0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.101511 Nov 12 02:35:37.724124 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 604/1178] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:37 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:35:38.279619 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-28b6b33a-2407-4408-aac3-1ec4a6042824 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:38.280322 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-28b6b33a-2407-4408-aac3-1ec4a6042824 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:38.287436 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28b6b33a-2407-4408-aac3-1ec4a6042824 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:38.287891 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28b6b33a-2407-4408-aac3-1ec4a6042824 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:38.288681 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28b6b33a-2407-4408-aac3-1ec4a6042824 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:38.289120 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-28b6b33a-2407-4408-aac3-1ec4a6042824 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:38.436499 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-28b6b33a-2407-4408-aac3-1ec4a6042824 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:38.444409 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-28b6b33a-2407-4408-aac3-1ec4a6042824 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1266 microversion: 2.1 time: 0.168831 Nov 12 02:35:38.444982 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 575/1179] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:38 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:38.543106 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-35607873-cf29-4512-abaf-e8e087112210 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:38.544092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-35607873-cf29-4512-abaf-e8e087112210 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:38.550896 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35607873-cf29-4512-abaf-e8e087112210 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:38.551344 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35607873-cf29-4512-abaf-e8e087112210 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:38.552109 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35607873-cf29-4512-abaf-e8e087112210 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:38.553046 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35607873-cf29-4512-abaf-e8e087112210 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:38.665994 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-35607873-cf29-4512-abaf-e8e087112210 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 38185 microversion: 2.20 time: 0.126830 Nov 12 02:35:38.666769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 605/1180] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:38 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 38185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:38.736285 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-506066ff-7c76-4b38-b3fb-a15c58d0fdc9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:38.737120 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-506066ff-7c76-4b38-b3fb-a15c58d0fdc9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:38.744237 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-506066ff-7c76-4b38-b3fb-a15c58d0fdc9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:38.744689 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-506066ff-7c76-4b38-b3fb-a15c58d0fdc9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:38.745472 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-506066ff-7c76-4b38-b3fb-a15c58d0fdc9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:38.745905 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-506066ff-7c76-4b38-b3fb-a15c58d0fdc9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:38.990578 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-506066ff-7c76-4b38-b3fb-a15c58d0fdc9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.258117 Nov 12 02:35:38.991231 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 576/1181] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:38 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:35:39.461190 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1b87a0d7-9a7c-49f0-99d5-4b51a9f55a08 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:39.461895 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1b87a0d7-9a7c-49f0-99d5-4b51a9f55a08 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:39.468941 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1b87a0d7-9a7c-49f0-99d5-4b51a9f55a08 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:39.469386 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1b87a0d7-9a7c-49f0-99d5-4b51a9f55a08 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:39.470167 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1b87a0d7-9a7c-49f0-99d5-4b51a9f55a08 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:39.470606 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1b87a0d7-9a7c-49f0-99d5-4b51a9f55a08 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:39.610416 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1b87a0d7-9a7c-49f0-99d5-4b51a9f55a08 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:39.618866 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1b87a0d7-9a7c-49f0-99d5-4b51a9f55a08 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1266 microversion: 2.1 time: 0.161627 Nov 12 02:35:39.619435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 606/1182] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:39 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:39.679187 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-66a0d7d4-6940-4133-aa3a-77de8e522305 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:39.680133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-66a0d7d4-6940-4133-aa3a-77de8e522305 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:39.687909 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66a0d7d4-6940-4133-aa3a-77de8e522305 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:39.688356 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66a0d7d4-6940-4133-aa3a-77de8e522305 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:39.689151 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66a0d7d4-6940-4133-aa3a-77de8e522305 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:39.689586 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-66a0d7d4-6940-4133-aa3a-77de8e522305 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:39.780227 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-66a0d7d4-6940-4133-aa3a-77de8e522305 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 38185 microversion: 2.20 time: 0.105504 Nov 12 02:35:39.780891 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 577/1183] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:39 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 38185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:40.005067 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ce25fe0d-832b-4695-ae60-510a28368bb9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:40.006633 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ce25fe0d-832b-4695-ae60-510a28368bb9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:40.013037 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ce25fe0d-832b-4695-ae60-510a28368bb9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:40.013476 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ce25fe0d-832b-4695-ae60-510a28368bb9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:40.014261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ce25fe0d-832b-4695-ae60-510a28368bb9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:40.014728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ce25fe0d-832b-4695-ae60-510a28368bb9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:40.124876 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ce25fe0d-832b-4695-ae60-510a28368bb9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.123320 Nov 12 02:35:40.125534 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 607/1184] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:40 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:35:40.638403 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-15d980ea-c21c-4e1e-a836-1f70771d96e1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:40.639649 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-15d980ea-c21c-4e1e-a836-1f70771d96e1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:40.652728 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-15d980ea-c21c-4e1e-a836-1f70771d96e1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:40.653542 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-15d980ea-c21c-4e1e-a836-1f70771d96e1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:40.654998 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-15d980ea-c21c-4e1e-a836-1f70771d96e1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:40.655784 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-15d980ea-c21c-4e1e-a836-1f70771d96e1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:40.794029 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d966b737-ff90-4473-84c2-3267255a89af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:40.795184 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d966b737-ff90-4473-84c2-3267255a89af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:40.800286 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-15d980ea-c21c-4e1e-a836-1f70771d96e1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:40.802764 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d966b737-ff90-4473-84c2-3267255a89af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:40.803486 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d966b737-ff90-4473-84c2-3267255a89af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:40.804380 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d966b737-ff90-4473-84c2-3267255a89af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:40.804893 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d966b737-ff90-4473-84c2-3267255a89af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:40.808165 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-15d980ea-c21c-4e1e-a836-1f70771d96e1 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1266 microversion: 2.1 time: 0.173825 Nov 12 02:35:40.808775 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 578/1185] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:40 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:40.893286 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d966b737-ff90-4473-84c2-3267255a89af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 38185 microversion: 2.20 time: 0.103240 Nov 12 02:35:40.893972 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 608/1186] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:40 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 38185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:35:41.136676 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0e9a3889-d39c-496f-bcab-f2509b5c086c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:41.137591 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0e9a3889-d39c-496f-bcab-f2509b5c086c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:41.144216 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0e9a3889-d39c-496f-bcab-f2509b5c086c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:41.144567 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0e9a3889-d39c-496f-bcab-f2509b5c086c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:41.145352 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0e9a3889-d39c-496f-bcab-f2509b5c086c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:41.145790 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0e9a3889-d39c-496f-bcab-f2509b5c086c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:41.234465 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0e9a3889-d39c-496f-bcab-f2509b5c086c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.101242 Nov 12 02:35:41.235143 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 579/1187] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:41 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:41.825636 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-43ca38a9-66bc-4317-92df-40bec660eedd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:41.826331 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-43ca38a9-66bc-4317-92df-40bec660eedd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:41.833433 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-43ca38a9-66bc-4317-92df-40bec660eedd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:41.834401 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-43ca38a9-66bc-4317-92df-40bec660eedd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:41.835235 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-43ca38a9-66bc-4317-92df-40bec660eedd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:41.835669 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-43ca38a9-66bc-4317-92df-40bec660eedd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:41.907322 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-619626c6-33e0-48af-81cd-8334ba4b8148 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:41.908663 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-619626c6-33e0-48af-81cd-8334ba4b8148 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:41.916092 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-619626c6-33e0-48af-81cd-8334ba4b8148 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:41.916539 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-619626c6-33e0-48af-81cd-8334ba4b8148 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:41.917326 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-619626c6-33e0-48af-81cd-8334ba4b8148 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:41.917759 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-619626c6-33e0-48af-81cd-8334ba4b8148 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:41.979231 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-43ca38a9-66bc-4317-92df-40bec660eedd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:41.986645 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-43ca38a9-66bc-4317-92df-40bec660eedd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1266 microversion: 2.1 time: 0.164985 Nov 12 02:35:41.987261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 609/1188] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:41 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:42.026605 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-619626c6-33e0-48af-81cd-8334ba4b8148 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 200 len: 38326 microversion: 2.20 time: 0.124203 Nov 12 02:35:42.027290 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 580/1189] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:41 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 38326 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:35:42.037352 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7955a713-9670-4b4b-a977-1675e8dfcd31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:42.037848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7955a713-9670-4b4b-a977-1675e8dfcd31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:42.044069 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7955a713-9670-4b4b-a977-1675e8dfcd31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:42.044439 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7955a713-9670-4b4b-a977-1675e8dfcd31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:42.045239 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7955a713-9670-4b4b-a977-1675e8dfcd31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:42.045673 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7955a713-9670-4b4b-a977-1675e8dfcd31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:42.069402 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7955a713-9670-4b4b-a977-1675e8dfcd31 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/ips" status: 200 len: 151 microversion: 2.20 time: 0.035744 Nov 12 02:35:42.070046 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 610/1190] 10.222.0.70 () {60 vars in 1288 bytes} [Fri Nov 12 02:35:42 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:35:42.247659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c364e6c3-9b5f-4c07-ac77-bc4b3385ee53 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:42.248705 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c364e6c3-9b5f-4c07-ac77-bc4b3385ee53 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:42.256598 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c364e6c3-9b5f-4c07-ac77-bc4b3385ee53 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:42.256994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c364e6c3-9b5f-4c07-ac77-bc4b3385ee53 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:42.257790 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c364e6c3-9b5f-4c07-ac77-bc4b3385ee53 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:42.258231 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c364e6c3-9b5f-4c07-ac77-bc4b3385ee53 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:42.400496 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c364e6c3-9b5f-4c07-ac77-bc4b3385ee53 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.156825 Nov 12 02:35:42.401148 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 581/1191] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:42 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:43.003292 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4b51bc0c-c68c-4794-921e-eacbbef837e8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:43.003914 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4b51bc0c-c68c-4794-921e-eacbbef837e8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:43.010907 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4b51bc0c-c68c-4794-921e-eacbbef837e8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:43.011371 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4b51bc0c-c68c-4794-921e-eacbbef837e8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:43.012149 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4b51bc0c-c68c-4794-921e-eacbbef837e8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:43.012588 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4b51bc0c-c68c-4794-921e-eacbbef837e8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:43.152467 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4b51bc0c-c68c-4794-921e-eacbbef837e8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:43.160253 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4b51bc0c-c68c-4794-921e-eacbbef837e8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1266 microversion: 2.1 time: 0.160665 Nov 12 02:35:43.160817 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 611/1192] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:42 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:43.413840 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3d262995-7526-44e1-a6a8-10fb21a13355 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:43.414890 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3d262995-7526-44e1-a6a8-10fb21a13355 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:43.421773 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3d262995-7526-44e1-a6a8-10fb21a13355 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:43.422217 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3d262995-7526-44e1-a6a8-10fb21a13355 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:43.423027 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3d262995-7526-44e1-a6a8-10fb21a13355 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:43.423459 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3d262995-7526-44e1-a6a8-10fb21a13355 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:43.515157 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3d262995-7526-44e1-a6a8-10fb21a13355 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.105627 Nov 12 02:35:43.515803 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 582/1193] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:43 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:44.177235 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-251e8693-80cb-4d86-b98d-dd24910caac5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:44.177869 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-251e8693-80cb-4d86-b98d-dd24910caac5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:44.184506 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-251e8693-80cb-4d86-b98d-dd24910caac5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:44.184956 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-251e8693-80cb-4d86-b98d-dd24910caac5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:44.186743 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-251e8693-80cb-4d86-b98d-dd24910caac5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:44.187191 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-251e8693-80cb-4d86-b98d-dd24910caac5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:44.343677 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-251e8693-80cb-4d86-b98d-dd24910caac5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:44.358004 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-251e8693-80cb-4d86-b98d-dd24910caac5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1266 microversion: 2.1 time: 0.184158 Nov 12 02:35:44.358616 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 612/1194] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:44 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:44.527514 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-671bc3d4-4a11-4a4d-9c26-ac99f5adfdbe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:44.528534 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-671bc3d4-4a11-4a4d-9c26-ac99f5adfdbe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:44.537691 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-671bc3d4-4a11-4a4d-9c26-ac99f5adfdbe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:44.538148 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-671bc3d4-4a11-4a4d-9c26-ac99f5adfdbe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:44.539023 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-671bc3d4-4a11-4a4d-9c26-ac99f5adfdbe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:44.539466 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-671bc3d4-4a11-4a4d-9c26-ac99f5adfdbe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:44.584314 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2454e82f-fc4b-4c49-bf19-011911f7aa98 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:44.584878 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2454e82f-fc4b-4c49-bf19-011911f7aa98 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:44.590908 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2454e82f-fc4b-4c49-bf19-011911f7aa98 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:44.591363 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2454e82f-fc4b-4c49-bf19-011911f7aa98 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:44.592149 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2454e82f-fc4b-4c49-bf19-011911f7aa98 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:44.592613 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2454e82f-fc4b-4c49-bf19-011911f7aa98 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:44.615771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-2454e82f-fc4b-4c49-bf19-011911f7aa98 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lazy-loading 'flavor' on Instance uuid d75cfef8-bb7c-41d9-b969-d4f2454a64fd {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:35:44.706580 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-671bc3d4-4a11-4a4d-9c26-ac99f5adfdbe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.182956 Nov 12 02:35:44.710755 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 583/1195] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:44 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:44.889455 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2454e82f-fc4b-4c49-bf19-011911f7aa98 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 202 len: 0 microversion: 2.20 time: 0.308768 Nov 12 02:35:44.890188 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 613/1196] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:35:44 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 12 02:35:44.898980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e1fbf571-ff30-47bb-a9ce-d69a8f928800 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:44.899777 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e1fbf571-ff30-47bb-a9ce-d69a8f928800 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:44.907474 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e1fbf571-ff30-47bb-a9ce-d69a8f928800 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:44.907990 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e1fbf571-ff30-47bb-a9ce-d69a8f928800 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:44.908842 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e1fbf571-ff30-47bb-a9ce-d69a8f928800 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:44.909312 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e1fbf571-ff30-47bb-a9ce-d69a8f928800 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:45.055488 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e1fbf571-ff30-47bb-a9ce-d69a8f928800 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:45.063873 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e1fbf571-ff30-47bb-a9ce-d69a8f928800 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:45.065364 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e1fbf571-ff30-47bb-a9ce-d69a8f928800 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:45.066521 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e1fbf571-ff30-47bb-a9ce-d69a8f928800 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.172024 Nov 12 02:35:45.067113 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 584/1197] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:35:44 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:35:45.376717 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a784ebdf-cf3b-4079-9ad6-4d5b6d2f8a0c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:45.377439 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a784ebdf-cf3b-4079-9ad6-4d5b6d2f8a0c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:45.385000 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a784ebdf-cf3b-4079-9ad6-4d5b6d2f8a0c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:45.385448 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a784ebdf-cf3b-4079-9ad6-4d5b6d2f8a0c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:45.386270 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a784ebdf-cf3b-4079-9ad6-4d5b6d2f8a0c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:45.386758 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a784ebdf-cf3b-4079-9ad6-4d5b6d2f8a0c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:45.524442 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a784ebdf-cf3b-4079-9ad6-4d5b6d2f8a0c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:45.532065 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a784ebdf-cf3b-4079-9ad6-4d5b6d2f8a0c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1266 microversion: 2.1 time: 0.159394 Nov 12 02:35:45.532774 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 614/1198] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:45 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:45.718527 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0008e0da-0dc0-43c5-9b9d-d9dd78509272 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:45.719387 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0008e0da-0dc0-43c5-9b9d-d9dd78509272 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:45.726153 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0008e0da-0dc0-43c5-9b9d-d9dd78509272 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:45.726594 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0008e0da-0dc0-43c5-9b9d-d9dd78509272 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:45.727398 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0008e0da-0dc0-43c5-9b9d-d9dd78509272 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:45.727820 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0008e0da-0dc0-43c5-9b9d-d9dd78509272 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:45.832580 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0008e0da-0dc0-43c5-9b9d-d9dd78509272 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.117598 Nov 12 02:35:45.833230 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 585/1199] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:45 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:46.085915 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fe2c80b8-8725-4510-8b19-744c1edd94cd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:46.086428 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-fe2c80b8-8725-4510-8b19-744c1edd94cd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:46.092909 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fe2c80b8-8725-4510-8b19-744c1edd94cd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:46.093362 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fe2c80b8-8725-4510-8b19-744c1edd94cd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:46.094133 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fe2c80b8-8725-4510-8b19-744c1edd94cd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:46.094562 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fe2c80b8-8725-4510-8b19-744c1edd94cd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:46.232389 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-fe2c80b8-8725-4510-8b19-744c1edd94cd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:46.242128 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-fe2c80b8-8725-4510-8b19-744c1edd94cd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:46.243917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-fe2c80b8-8725-4510-8b19-744c1edd94cd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:46.245146 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-fe2c80b8-8725-4510-8b19-744c1edd94cd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.163652 Nov 12 02:35:46.245773 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 615/1200] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:35:46 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:35:46.367258 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-3991e08a-f3fb-4cf9-bb15-725ccaf0b501 req-a124474f-cc7a-4e7f-85bb-5398ede40df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83a6744-71fc-40f8-b0f5-7fbf936ddaea", "name": "network-vif-plugged", "status": "completed", "tag": "485ec9f6-9b65-4fdd-93d9-7e0ef9c14d71"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:46.368884 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:35:46.368884 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:35:46.377977 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-3991e08a-f3fb-4cf9-bb15-725ccaf0b501 req-a124474f-cc7a-4e7f-85bb-5398ede40df9 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:46.379087 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-3991e08a-f3fb-4cf9-bb15-725ccaf0b501 req-a124474f-cc7a-4e7f-85bb-5398ede40df9 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:46.401088 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-3991e08a-f3fb-4cf9-bb15-725ccaf0b501 req-a124474f-cc7a-4e7f-85bb-5398ede40df9 service nova] Creating event network-vif-plugged:485ec9f6-9b65-4fdd-93d9-7e0ef9c14d71 for instance b83a6744-71fc-40f8-b0f5-7fbf936ddaea on hv-cinder-80857 Nov 12 02:35:46.406857 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-3991e08a-f3fb-4cf9-bb15-725ccaf0b501 req-a124474f-cc7a-4e7f-85bb-5398ede40df9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043412 Nov 12 02:35:46.407250 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 586/1201] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:35:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:35:46.548568 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-18ece476-4a4c-47a9-a9b0-1809b417e15c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:46.549220 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-18ece476-4a4c-47a9-a9b0-1809b417e15c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:46.555368 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18ece476-4a4c-47a9-a9b0-1809b417e15c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:46.555828 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18ece476-4a4c-47a9-a9b0-1809b417e15c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:46.556623 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18ece476-4a4c-47a9-a9b0-1809b417e15c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:46.557066 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-18ece476-4a4c-47a9-a9b0-1809b417e15c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:46.745878 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-18ece476-4a4c-47a9-a9b0-1809b417e15c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:46.758530 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-18ece476-4a4c-47a9-a9b0-1809b417e15c tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1266 microversion: 2.1 time: 0.213305 Nov 12 02:35:46.759514 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 616/1202] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:46 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:46.845480 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-19d22cfd-c9fc-41bd-aa8e-7000c86e1ffe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:46.846568 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-19d22cfd-c9fc-41bd-aa8e-7000c86e1ffe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:46.853811 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-19d22cfd-c9fc-41bd-aa8e-7000c86e1ffe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:46.854283 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-19d22cfd-c9fc-41bd-aa8e-7000c86e1ffe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:46.855081 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-19d22cfd-c9fc-41bd-aa8e-7000c86e1ffe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:46.855522 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-19d22cfd-c9fc-41bd-aa8e-7000c86e1ffe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:47.264209 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8e5526e2-292f-4c4c-8e28-7fbcd1ccf2b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:47.264806 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8e5526e2-292f-4c4c-8e28-7fbcd1ccf2b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:47.271318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e5526e2-292f-4c4c-8e28-7fbcd1ccf2b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:47.271765 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e5526e2-292f-4c4c-8e28-7fbcd1ccf2b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:47.272542 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e5526e2-292f-4c4c-8e28-7fbcd1ccf2b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:47.272971 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e5526e2-292f-4c4c-8e28-7fbcd1ccf2b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:47.406412 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8e5526e2-292f-4c4c-8e28-7fbcd1ccf2b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:47.415110 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8e5526e2-292f-4c4c-8e28-7fbcd1ccf2b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:47.416596 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8e5526e2-292f-4c4c-8e28-7fbcd1ccf2b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:47.417755 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8e5526e2-292f-4c4c-8e28-7fbcd1ccf2b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.157321 Nov 12 02:35:47.418309 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 617/1203] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:35:47 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:35:47.460512 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-19d22cfd-c9fc-41bd-aa8e-7000c86e1ffe tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.619009 Nov 12 02:35:47.461164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 587/1204] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:46 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:47.777032 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9920d415-e887-4121-8875-e6c1575779c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:47.777565 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9920d415-e887-4121-8875-e6c1575779c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:47.783478 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9920d415-e887-4121-8875-e6c1575779c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:47.783924 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9920d415-e887-4121-8875-e6c1575779c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:47.784737 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9920d415-e887-4121-8875-e6c1575779c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:47.785167 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9920d415-e887-4121-8875-e6c1575779c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:47.929362 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-9920d415-e887-4121-8875-e6c1575779c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:47.937467 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9920d415-e887-4121-8875-e6c1575779c5 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1266 microversion: 2.1 time: 0.164104 Nov 12 02:35:47.938719 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 618/1205] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:47 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:48.437162 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-797f30f1-7311-49de-ae5d-2760189cee41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:48.437772 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-797f30f1-7311-49de-ae5d-2760189cee41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:48.445516 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-797f30f1-7311-49de-ae5d-2760189cee41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:48.445965 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-797f30f1-7311-49de-ae5d-2760189cee41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:48.446779 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-797f30f1-7311-49de-ae5d-2760189cee41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:48.447217 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-797f30f1-7311-49de-ae5d-2760189cee41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:48.472112 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-24342cb2-d342-483e-9f24-67814fabe5eb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:48.473068 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-24342cb2-d342-483e-9f24-67814fabe5eb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:48.479772 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-24342cb2-d342-483e-9f24-67814fabe5eb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:48.480168 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-24342cb2-d342-483e-9f24-67814fabe5eb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:48.481259 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-24342cb2-d342-483e-9f24-67814fabe5eb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:48.481740 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-24342cb2-d342-483e-9f24-67814fabe5eb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:48.588701 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-797f30f1-7311-49de-ae5d-2760189cee41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:48.596693 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-797f30f1-7311-49de-ae5d-2760189cee41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:48.598204 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-797f30f1-7311-49de-ae5d-2760189cee41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:48.599932 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-797f30f1-7311-49de-ae5d-2760189cee41 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.166511 Nov 12 02:35:48.610837 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 588/1206] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:35:48 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:35:48.676666 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-24342cb2-d342-483e-9f24-67814fabe5eb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.207968 Nov 12 02:35:48.678203 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 619/1207] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:48 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:35:48.954658 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-134649d8-18d9-4d0f-afa0-abc8a416acb2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:48.955292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-134649d8-18d9-4d0f-afa0-abc8a416acb2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:48.962236 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-134649d8-18d9-4d0f-afa0-abc8a416acb2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:48.962706 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-134649d8-18d9-4d0f-afa0-abc8a416acb2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:48.963499 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-134649d8-18d9-4d0f-afa0-abc8a416acb2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:48.963934 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-134649d8-18d9-4d0f-afa0-abc8a416acb2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:49.100540 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-134649d8-18d9-4d0f-afa0-abc8a416acb2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:49.108015 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-134649d8-18d9-4d0f-afa0-abc8a416acb2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1452 microversion: 2.1 time: 0.157059 Nov 12 02:35:49.108602 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 589/1208] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:48 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:49.124787 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-19d6df1f-8653-4bd2-a09b-3161201417e2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:49.125490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-19d6df1f-8653-4bd2-a09b-3161201417e2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:49.132509 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-19d6df1f-8653-4bd2-a09b-3161201417e2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:49.132960 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-19d6df1f-8653-4bd2-a09b-3161201417e2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:49.133752 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-19d6df1f-8653-4bd2-a09b-3161201417e2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:49.134195 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-19d6df1f-8653-4bd2-a09b-3161201417e2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:49.274589 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-19d6df1f-8653-4bd2-a09b-3161201417e2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:49.282136 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-19d6df1f-8653-4bd2-a09b-3161201417e2 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1452 microversion: 2.1 time: 0.161341 Nov 12 02:35:49.282734 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 620/1209] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:35:49 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:35:49.619649 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cb34fb34-c6f3-45ff-8df6-3126d138c96e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:49.620288 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cb34fb34-c6f3-45ff-8df6-3126d138c96e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:49.626722 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cb34fb34-c6f3-45ff-8df6-3126d138c96e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:49.627171 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cb34fb34-c6f3-45ff-8df6-3126d138c96e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:49.628644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cb34fb34-c6f3-45ff-8df6-3126d138c96e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:49.629389 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cb34fb34-c6f3-45ff-8df6-3126d138c96e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:49.688922 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a284d7a9-542b-4e9f-8397-723ca89518ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:49.689838 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a284d7a9-542b-4e9f-8397-723ca89518ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:49.696302 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a284d7a9-542b-4e9f-8397-723ca89518ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:49.696748 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a284d7a9-542b-4e9f-8397-723ca89518ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:49.697546 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a284d7a9-542b-4e9f-8397-723ca89518ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:49.697980 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a284d7a9-542b-4e9f-8397-723ca89518ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:49.799919 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a284d7a9-542b-4e9f-8397-723ca89518ec tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.114540 Nov 12 02:35:49.800567 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 621/1210] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:49 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:35:49.865658 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cb34fb34-c6f3-45ff-8df6-3126d138c96e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:49.877744 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cb34fb34-c6f3-45ff-8df6-3126d138c96e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:49.879302 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cb34fb34-c6f3-45ff-8df6-3126d138c96e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:49.880746 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cb34fb34-c6f3-45ff-8df6-3126d138c96e tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.265938 Nov 12 02:35:49.881311 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 590/1211] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:35:49 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:35:50.812557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2bfba5f6-0c5c-4335-920b-c623d31b98c3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:50.813567 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2bfba5f6-0c5c-4335-920b-c623d31b98c3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:50.822630 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2bfba5f6-0c5c-4335-920b-c623d31b98c3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:50.823181 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2bfba5f6-0c5c-4335-920b-c623d31b98c3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:50.823982 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2bfba5f6-0c5c-4335-920b-c623d31b98c3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:50.824508 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2bfba5f6-0c5c-4335-920b-c623d31b98c3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:50.900728 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ca9b759a-8ed7-4af7-a7c6-ee1df171df93 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:50.901347 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ca9b759a-8ed7-4af7-a7c6-ee1df171df93 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:50.907944 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca9b759a-8ed7-4af7-a7c6-ee1df171df93 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:50.908398 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca9b759a-8ed7-4af7-a7c6-ee1df171df93 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:50.909187 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca9b759a-8ed7-4af7-a7c6-ee1df171df93 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:50.909680 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca9b759a-8ed7-4af7-a7c6-ee1df171df93 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:50.929156 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2bfba5f6-0c5c-4335-920b-c623d31b98c3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.120325 Nov 12 02:35:50.930945 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 622/1212] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:50 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:51.183002 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ca9b759a-8ed7-4af7-a7c6-ee1df171df93 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:51.191210 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ca9b759a-8ed7-4af7-a7c6-ee1df171df93 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:51.192711 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ca9b759a-8ed7-4af7-a7c6-ee1df171df93 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:51.193886 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ca9b759a-8ed7-4af7-a7c6-ee1df171df93 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.297535 Nov 12 02:35:51.194445 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 591/1213] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:35:50 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:35:51.543665 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-c6a0bf61-a45f-4853-a92e-3866cbf2df05 req-77c7d133-13f2-4164-8f9b-295603ae2222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83a6744-71fc-40f8-b0f5-7fbf936ddaea", "tag": "485ec9f6-9b65-4fdd-93d9-7e0ef9c14d71"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:51.545157 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:35:51.545157 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:35:51.555724 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-c6a0bf61-a45f-4853-a92e-3866cbf2df05 req-77c7d133-13f2-4164-8f9b-295603ae2222 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:51.556156 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-c6a0bf61-a45f-4853-a92e-3866cbf2df05 req-77c7d133-13f2-4164-8f9b-295603ae2222 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:51.567751 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-c6a0bf61-a45f-4853-a92e-3866cbf2df05 req-77c7d133-13f2-4164-8f9b-295603ae2222 service nova] Creating event network-changed:485ec9f6-9b65-4fdd-93d9-7e0ef9c14d71 for instance b83a6744-71fc-40f8-b0f5-7fbf936ddaea on hv-cinder-80857 Nov 12 02:35:51.573233 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-c6a0bf61-a45f-4853-a92e-3866cbf2df05 req-77c7d133-13f2-4164-8f9b-295603ae2222 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034240 Nov 12 02:35:51.573823 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 623/1214] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:35:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:35:51.944631 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3261d72c-6e36-4684-8ded-965524e4e750 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:51.945765 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3261d72c-6e36-4684-8ded-965524e4e750 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:51.952194 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3261d72c-6e36-4684-8ded-965524e4e750 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:51.952644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3261d72c-6e36-4684-8ded-965524e4e750 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:51.953433 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3261d72c-6e36-4684-8ded-965524e4e750 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:51.953934 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3261d72c-6e36-4684-8ded-965524e4e750 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:52.049426 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3261d72c-6e36-4684-8ded-965524e4e750 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.110996 Nov 12 02:35:52.050540 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 592/1215] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:51 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:52.213291 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-59513280-9f74-475d-bd30-a291d128b017 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:52.214092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-59513280-9f74-475d-bd30-a291d128b017 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:52.222033 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-59513280-9f74-475d-bd30-a291d128b017 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:52.222521 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-59513280-9f74-475d-bd30-a291d128b017 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:52.223379 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-59513280-9f74-475d-bd30-a291d128b017 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:52.223809 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-59513280-9f74-475d-bd30-a291d128b017 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:52.364826 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-59513280-9f74-475d-bd30-a291d128b017 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:52.373294 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-59513280-9f74-475d-bd30-a291d128b017 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:52.374944 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-59513280-9f74-475d-bd30-a291d128b017 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:52.376243 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-59513280-9f74-475d-bd30-a291d128b017 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.167521 Nov 12 02:35:52.376894 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 624/1216] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:35:52 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:35:53.062368 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1a94a0ae-3758-4af7-a167-aa2469cbda1b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:53.063340 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1a94a0ae-3758-4af7-a167-aa2469cbda1b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:53.071452 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1a94a0ae-3758-4af7-a167-aa2469cbda1b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:53.071905 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1a94a0ae-3758-4af7-a167-aa2469cbda1b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:53.072688 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1a94a0ae-3758-4af7-a167-aa2469cbda1b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:53.073123 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1a94a0ae-3758-4af7-a167-aa2469cbda1b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:53.190357 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1a94a0ae-3758-4af7-a167-aa2469cbda1b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.131921 Nov 12 02:35:53.191041 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 593/1217] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:53 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:53.395004 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-500ddccf-86e6-4e88-bbd7-3a6b04143051 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:53.395632 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-500ddccf-86e6-4e88-bbd7-3a6b04143051 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:53.403698 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-500ddccf-86e6-4e88-bbd7-3a6b04143051 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:53.404150 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-500ddccf-86e6-4e88-bbd7-3a6b04143051 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:53.404924 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-500ddccf-86e6-4e88-bbd7-3a6b04143051 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:53.405357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-500ddccf-86e6-4e88-bbd7-3a6b04143051 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:53.544410 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-500ddccf-86e6-4e88-bbd7-3a6b04143051 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:53.552830 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-500ddccf-86e6-4e88-bbd7-3a6b04143051 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:53.554333 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-500ddccf-86e6-4e88-bbd7-3a6b04143051 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:53.555532 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-500ddccf-86e6-4e88-bbd7-3a6b04143051 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.164258 Nov 12 02:35:53.556087 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 625/1218] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:35:53 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:35:54.202850 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bb06bb84-0e47-40b0-a57f-5d144fe3274e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:54.203890 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bb06bb84-0e47-40b0-a57f-5d144fe3274e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:54.211451 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb06bb84-0e47-40b0-a57f-5d144fe3274e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:54.211900 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb06bb84-0e47-40b0-a57f-5d144fe3274e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:54.212687 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb06bb84-0e47-40b0-a57f-5d144fe3274e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:54.213124 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bb06bb84-0e47-40b0-a57f-5d144fe3274e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:54.321795 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bb06bb84-0e47-40b0-a57f-5d144fe3274e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.122792 Nov 12 02:35:54.322445 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 594/1219] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:54 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:54.574478 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-906fcef1-8e7a-492c-ada6-a7893b806455 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:54.575072 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-906fcef1-8e7a-492c-ada6-a7893b806455 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:54.581564 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-906fcef1-8e7a-492c-ada6-a7893b806455 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:54.582027 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-906fcef1-8e7a-492c-ada6-a7893b806455 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:54.582889 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-906fcef1-8e7a-492c-ada6-a7893b806455 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:54.583361 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-906fcef1-8e7a-492c-ada6-a7893b806455 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:54.718736 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-906fcef1-8e7a-492c-ada6-a7893b806455 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:54.727269 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-906fcef1-8e7a-492c-ada6-a7893b806455 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:54.728719 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-906fcef1-8e7a-492c-ada6-a7893b806455 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:54.730165 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-906fcef1-8e7a-492c-ada6-a7893b806455 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.159372 Nov 12 02:35:54.731020 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 626/1220] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:35:54 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:35:55.333388 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-218daa39-2872-4b05-b786-bb04b518511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:55.334394 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-218daa39-2872-4b05-b786-bb04b518511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:55.341655 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-218daa39-2872-4b05-b786-bb04b518511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:55.342104 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-218daa39-2872-4b05-b786-bb04b518511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:55.342925 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-218daa39-2872-4b05-b786-bb04b518511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:55.343369 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-218daa39-2872-4b05-b786-bb04b518511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:55.441686 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-218daa39-2872-4b05-b786-bb04b518511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.112089 Nov 12 02:35:55.442277 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 595/1221] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:55 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:55.750727 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0e825866-0f4b-4c38-8cce-97a1db1abac5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:55.751318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0e825866-0f4b-4c38-8cce-97a1db1abac5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:55.758286 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0e825866-0f4b-4c38-8cce-97a1db1abac5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:55.758769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0e825866-0f4b-4c38-8cce-97a1db1abac5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:55.759566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0e825866-0f4b-4c38-8cce-97a1db1abac5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:55.761073 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0e825866-0f4b-4c38-8cce-97a1db1abac5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:55.913648 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0e825866-0f4b-4c38-8cce-97a1db1abac5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:55.921526 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0e825866-0f4b-4c38-8cce-97a1db1abac5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:55.923049 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0e825866-0f4b-4c38-8cce-97a1db1abac5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:55.924214 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0e825866-0f4b-4c38-8cce-97a1db1abac5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.177372 Nov 12 02:35:55.924768 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 627/1222] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:35:55 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:35:56.454001 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b5cefd0a-edc1-4cc8-8a76-ccd807ab8bba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:56.454943 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b5cefd0a-edc1-4cc8-8a76-ccd807ab8bba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:56.462640 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5cefd0a-edc1-4cc8-8a76-ccd807ab8bba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:56.463194 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5cefd0a-edc1-4cc8-8a76-ccd807ab8bba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:56.464014 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5cefd0a-edc1-4cc8-8a76-ccd807ab8bba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:56.464454 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b5cefd0a-edc1-4cc8-8a76-ccd807ab8bba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:56.570566 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b5cefd0a-edc1-4cc8-8a76-ccd807ab8bba tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.120481 Nov 12 02:35:56.571254 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 596/1223] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:56 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:56.943527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6855ab80-afeb-481e-ac68-ee1074fa4910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:56.944139 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6855ab80-afeb-481e-ac68-ee1074fa4910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:56.950365 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6855ab80-afeb-481e-ac68-ee1074fa4910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:56.950836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6855ab80-afeb-481e-ac68-ee1074fa4910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:56.951602 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6855ab80-afeb-481e-ac68-ee1074fa4910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:56.952029 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6855ab80-afeb-481e-ac68-ee1074fa4910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:57.080727 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6855ab80-afeb-481e-ac68-ee1074fa4910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:57.089162 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6855ab80-afeb-481e-ac68-ee1074fa4910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:57.090655 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6855ab80-afeb-481e-ac68-ee1074fa4910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:57.091836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6855ab80-afeb-481e-ac68-ee1074fa4910 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.152544 Nov 12 02:35:57.092392 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 628/1224] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:35:56 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:35:57.582051 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a8a29e66-65b5-46d0-9135-a6426b68bac7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:57.583618 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a8a29e66-65b5-46d0-9135-a6426b68bac7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:57.592472 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8a29e66-65b5-46d0-9135-a6426b68bac7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:57.592820 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8a29e66-65b5-46d0-9135-a6426b68bac7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:57.593595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8a29e66-65b5-46d0-9135-a6426b68bac7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:57.594032 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8a29e66-65b5-46d0-9135-a6426b68bac7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:57.684241 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a8a29e66-65b5-46d0-9135-a6426b68bac7 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.106077 Nov 12 02:35:57.684895 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 597/1225] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:57 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:58.110469 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-dd838988-5c24-4e7a-b00a-6014ea09bd25 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:58.111104 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-dd838988-5c24-4e7a-b00a-6014ea09bd25 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:58.118177 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dd838988-5c24-4e7a-b00a-6014ea09bd25 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:58.118626 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dd838988-5c24-4e7a-b00a-6014ea09bd25 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:58.119439 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dd838988-5c24-4e7a-b00a-6014ea09bd25 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:58.119871 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dd838988-5c24-4e7a-b00a-6014ea09bd25 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:58.262085 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-dd838988-5c24-4e7a-b00a-6014ea09bd25 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:58.270145 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-dd838988-5c24-4e7a-b00a-6014ea09bd25 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:58.272159 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-dd838988-5c24-4e7a-b00a-6014ea09bd25 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:58.273333 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-dd838988-5c24-4e7a-b00a-6014ea09bd25 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.166600 Nov 12 02:35:58.273886 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 629/1226] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:35:58 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:35:58.697292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2f4f1c8c-6ea9-4c51-90f9-dde8e8d68173 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:58.698301 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2f4f1c8c-6ea9-4c51-90f9-dde8e8d68173 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:58.705273 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f4f1c8c-6ea9-4c51-90f9-dde8e8d68173 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:58.705724 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f4f1c8c-6ea9-4c51-90f9-dde8e8d68173 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:58.706513 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f4f1c8c-6ea9-4c51-90f9-dde8e8d68173 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:58.706980 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2f4f1c8c-6ea9-4c51-90f9-dde8e8d68173 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:58.799280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2f4f1c8c-6ea9-4c51-90f9-dde8e8d68173 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.106435 Nov 12 02:35:58.799943 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 598/1227] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:58 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:35:59.291719 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c12ca7b0-cf54-4a77-868e-5f15b7c42680 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:35:59.292342 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c12ca7b0-cf54-4a77-868e-5f15b7c42680 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:59.298848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c12ca7b0-cf54-4a77-868e-5f15b7c42680 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:59.299267 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c12ca7b0-cf54-4a77-868e-5f15b7c42680 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:59.300058 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c12ca7b0-cf54-4a77-868e-5f15b7c42680 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:59.300496 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c12ca7b0-cf54-4a77-868e-5f15b7c42680 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:59.437164 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c12ca7b0-cf54-4a77-868e-5f15b7c42680 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:59.445789 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c12ca7b0-cf54-4a77-868e-5f15b7c42680 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:59.447372 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c12ca7b0-cf54-4a77-868e-5f15b7c42680 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:35:59.448541 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c12ca7b0-cf54-4a77-868e-5f15b7c42680 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.160642 Nov 12 02:35:59.449092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 630/1228] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:35:59 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:35:59.812532 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-697ad304-cf6d-4e55-ba8d-865100186153 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:35:59.813539 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-697ad304-cf6d-4e55-ba8d-865100186153 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:35:59.820597 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-697ad304-cf6d-4e55-ba8d-865100186153 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:59.821050 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-697ad304-cf6d-4e55-ba8d-865100186153 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:59.821844 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-697ad304-cf6d-4e55-ba8d-865100186153 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:35:59.822281 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-697ad304-cf6d-4e55-ba8d-865100186153 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:35:59.952883 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-697ad304-cf6d-4e55-ba8d-865100186153 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.144179 Nov 12 02:35:59.953538 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 599/1229] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:35:59 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:00.468147 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-98a756f1-d7d5-480f-aab4-6292d6816b49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:00.468715 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-98a756f1-d7d5-480f-aab4-6292d6816b49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:00.475602 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-98a756f1-d7d5-480f-aab4-6292d6816b49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:00.476055 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-98a756f1-d7d5-480f-aab4-6292d6816b49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:00.476842 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-98a756f1-d7d5-480f-aab4-6292d6816b49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:00.477282 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-98a756f1-d7d5-480f-aab4-6292d6816b49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:00.630690 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-98a756f1-d7d5-480f-aab4-6292d6816b49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:00.638470 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-98a756f1-d7d5-480f-aab4-6292d6816b49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:00.640014 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-98a756f1-d7d5-480f-aab4-6292d6816b49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:00.641181 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-98a756f1-d7d5-480f-aab4-6292d6816b49 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.176946 Nov 12 02:36:00.641738 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 631/1230] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:00 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:00.965975 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f1dd642c-76bd-4147-9ede-14a4ab474c72 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:00.967008 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f1dd642c-76bd-4147-9ede-14a4ab474c72 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:00.974656 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1dd642c-76bd-4147-9ede-14a4ab474c72 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:00.975117 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1dd642c-76bd-4147-9ede-14a4ab474c72 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:00.975901 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1dd642c-76bd-4147-9ede-14a4ab474c72 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:00.976330 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1dd642c-76bd-4147-9ede-14a4ab474c72 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:01.652856 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f1dd642c-76bd-4147-9ede-14a4ab474c72 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.690898 Nov 12 02:36:01.653531 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 600/1231] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:00 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:01.660275 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b4b1546d-9309-40f9-9cb8-3f5c61e05c56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:01.660893 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b4b1546d-9309-40f9-9cb8-3f5c61e05c56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:01.667295 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4b1546d-9309-40f9-9cb8-3f5c61e05c56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:01.667751 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4b1546d-9309-40f9-9cb8-3f5c61e05c56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:01.668539 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4b1546d-9309-40f9-9cb8-3f5c61e05c56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:01.668983 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b4b1546d-9309-40f9-9cb8-3f5c61e05c56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:01.816537 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b4b1546d-9309-40f9-9cb8-3f5c61e05c56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:01.826446 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b4b1546d-9309-40f9-9cb8-3f5c61e05c56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:01.828067 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b4b1546d-9309-40f9-9cb8-3f5c61e05c56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:01.829235 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b4b1546d-9309-40f9-9cb8-3f5c61e05c56 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.172832 Nov 12 02:36:01.829792 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 632/1232] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:01 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:02.666995 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-731b4b5a-731e-4305-9352-1647c12f5ef3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:02.668051 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-731b4b5a-731e-4305-9352-1647c12f5ef3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:02.675907 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-731b4b5a-731e-4305-9352-1647c12f5ef3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:02.676351 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-731b4b5a-731e-4305-9352-1647c12f5ef3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:02.677190 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-731b4b5a-731e-4305-9352-1647c12f5ef3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:02.677626 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-731b4b5a-731e-4305-9352-1647c12f5ef3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:02.772292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-731b4b5a-731e-4305-9352-1647c12f5ef3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.109453 Nov 12 02:36:02.772944 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 601/1233] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:02 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:36:02.847462 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-39abac81-22d6-4b76-a865-c05026489ad1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:02.848073 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-39abac81-22d6-4b76-a865-c05026489ad1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:02.855077 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-39abac81-22d6-4b76-a865-c05026489ad1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:02.855532 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-39abac81-22d6-4b76-a865-c05026489ad1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:02.856322 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-39abac81-22d6-4b76-a865-c05026489ad1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:02.856761 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-39abac81-22d6-4b76-a865-c05026489ad1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:03.005488 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-39abac81-22d6-4b76-a865-c05026489ad1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:03.013159 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-39abac81-22d6-4b76-a865-c05026489ad1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:03.014658 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-39abac81-22d6-4b76-a865-c05026489ad1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:03.015838 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-39abac81-22d6-4b76-a865-c05026489ad1 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1743 microversion: 2.20 time: 0.172188 Nov 12 02:36:03.016390 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 633/1234] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:02 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:03.785415 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-36c0e903-76c6-4182-8664-08ec66675850 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:03.786405 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-36c0e903-76c6-4182-8664-08ec66675850 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:03.793371 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36c0e903-76c6-4182-8664-08ec66675850 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:03.793813 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36c0e903-76c6-4182-8664-08ec66675850 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:03.794592 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36c0e903-76c6-4182-8664-08ec66675850 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:03.795048 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-36c0e903-76c6-4182-8664-08ec66675850 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:03.890267 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-36c0e903-76c6-4182-8664-08ec66675850 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.108806 Nov 12 02:36:03.890953 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 602/1235] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:03 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:04.035311 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-33221ecd-2716-4903-bda0-695fb28e32a2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:04.035864 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-33221ecd-2716-4903-bda0-695fb28e32a2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:04.042314 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-33221ecd-2716-4903-bda0-695fb28e32a2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:04.042787 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-33221ecd-2716-4903-bda0-695fb28e32a2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:04.043617 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-33221ecd-2716-4903-bda0-695fb28e32a2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:04.044057 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-33221ecd-2716-4903-bda0-695fb28e32a2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:04.181174 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-33221ecd-2716-4903-bda0-695fb28e32a2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:04.189258 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-33221ecd-2716-4903-bda0-695fb28e32a2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:04.190789 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-33221ecd-2716-4903-bda0-695fb28e32a2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:04.191980 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-33221ecd-2716-4903-bda0-695fb28e32a2 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1743 microversion: 2.20 time: 0.160508 Nov 12 02:36:04.192556 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 634/1236] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:04 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:04.901994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a4eab044-3fc9-4111-9fc5-5d0a61663e7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:04.903061 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a4eab044-3fc9-4111-9fc5-5d0a61663e7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:04.909987 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4eab044-3fc9-4111-9fc5-5d0a61663e7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:04.910437 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4eab044-3fc9-4111-9fc5-5d0a61663e7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:04.911280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4eab044-3fc9-4111-9fc5-5d0a61663e7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:04.911706 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a4eab044-3fc9-4111-9fc5-5d0a61663e7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:05.019188 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a4eab044-3fc9-4111-9fc5-5d0a61663e7b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.121022 Nov 12 02:36:05.019860 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 603/1237] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:04 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:36:05.210979 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d040586f-3697-4519-885c-167e518beb28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:05.211528 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d040586f-3697-4519-885c-167e518beb28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:05.218009 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d040586f-3697-4519-885c-167e518beb28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:05.218459 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d040586f-3697-4519-885c-167e518beb28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:05.219343 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d040586f-3697-4519-885c-167e518beb28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:05.219699 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d040586f-3697-4519-885c-167e518beb28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:05.357200 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d040586f-3697-4519-885c-167e518beb28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:05.366135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d040586f-3697-4519-885c-167e518beb28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:05.367915 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d040586f-3697-4519-885c-167e518beb28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:05.369130 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d040586f-3697-4519-885c-167e518beb28 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1743 microversion: 2.20 time: 0.162087 Nov 12 02:36:05.369691 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 635/1238] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:05 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:06.031888 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fe4ab519-27fc-4ff3-b537-3c9cfe752cce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:06.032888 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fe4ab519-27fc-4ff3-b537-3c9cfe752cce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:06.040361 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fe4ab519-27fc-4ff3-b537-3c9cfe752cce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:06.040816 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fe4ab519-27fc-4ff3-b537-3c9cfe752cce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:06.041601 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fe4ab519-27fc-4ff3-b537-3c9cfe752cce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:06.042036 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fe4ab519-27fc-4ff3-b537-3c9cfe752cce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:06.137074 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fe4ab519-27fc-4ff3-b537-3c9cfe752cce tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.109058 Nov 12 02:36:06.137726 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 604/1239] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:06 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:06.387024 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-857c315b-907b-4b51-8f8c-257f2f54d6f4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:06.387974 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-857c315b-907b-4b51-8f8c-257f2f54d6f4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:06.394058 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-857c315b-907b-4b51-8f8c-257f2f54d6f4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:06.394510 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-857c315b-907b-4b51-8f8c-257f2f54d6f4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:06.395343 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-857c315b-907b-4b51-8f8c-257f2f54d6f4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:06.395783 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-857c315b-907b-4b51-8f8c-257f2f54d6f4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:06.465050 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-de7f4758-bb6a-4363-9393-cd2e3fbf5a48 req-3aeeb90e-6acd-4fb1-b3fa-7767fb7e259b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75cfef8-bb7c-41d9-b969-d4f2454a64fd", "name": "network-vif-plugged", "status": "completed", "tag": "054e67ae-3cc3-4cc3-b945-349581ab03eb"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:06.466585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:36:06.466585 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:36:06.475478 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-de7f4758-bb6a-4363-9393-cd2e3fbf5a48 req-3aeeb90e-6acd-4fb1-b3fa-7767fb7e259b service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:06.476062 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-de7f4758-bb6a-4363-9393-cd2e3fbf5a48 req-3aeeb90e-6acd-4fb1-b3fa-7767fb7e259b service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:06.488538 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-de7f4758-bb6a-4363-9393-cd2e3fbf5a48 req-3aeeb90e-6acd-4fb1-b3fa-7767fb7e259b service nova] Creating event network-vif-plugged:054e67ae-3cc3-4cc3-b945-349581ab03eb for instance d75cfef8-bb7c-41d9-b969-d4f2454a64fd on hv-cinder-80857 Nov 12 02:36:06.494733 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-de7f4758-bb6a-4363-9393-cd2e3fbf5a48 req-3aeeb90e-6acd-4fb1-b3fa-7767fb7e259b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033613 Nov 12 02:36:06.495427 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 605/1240] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:36:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:36:06.541383 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-857c315b-907b-4b51-8f8c-257f2f54d6f4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:06.549373 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-857c315b-907b-4b51-8f8c-257f2f54d6f4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:06.550898 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-857c315b-907b-4b51-8f8c-257f2f54d6f4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:06.552072 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-857c315b-907b-4b51-8f8c-257f2f54d6f4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1743 microversion: 2.20 time: 0.168811 Nov 12 02:36:06.553134 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 636/1241] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:06 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:07.150374 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1fd94c2c-91ae-42ae-99a3-4a045e19459a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:07.151408 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1fd94c2c-91ae-42ae-99a3-4a045e19459a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:07.157572 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fd94c2c-91ae-42ae-99a3-4a045e19459a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:07.158022 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fd94c2c-91ae-42ae-99a3-4a045e19459a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:07.158865 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fd94c2c-91ae-42ae-99a3-4a045e19459a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:07.159286 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1fd94c2c-91ae-42ae-99a3-4a045e19459a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:07.253248 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1fd94c2c-91ae-42ae-99a3-4a045e19459a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.107821 Nov 12 02:36:07.253898 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 606/1242] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:07 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:07.571146 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-58eee612-b78e-4cf9-8658-7d73fefa98da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:07.571707 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-58eee612-b78e-4cf9-8658-7d73fefa98da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:07.580783 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58eee612-b78e-4cf9-8658-7d73fefa98da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:07.581490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58eee612-b78e-4cf9-8658-7d73fefa98da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:07.582760 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58eee612-b78e-4cf9-8658-7d73fefa98da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:07.583450 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-58eee612-b78e-4cf9-8658-7d73fefa98da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:07.719965 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-58eee612-b78e-4cf9-8658-7d73fefa98da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:07.730840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-58eee612-b78e-4cf9-8658-7d73fefa98da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:07.732423 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-58eee612-b78e-4cf9-8658-7d73fefa98da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:07.733607 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-58eee612-b78e-4cf9-8658-7d73fefa98da tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1743 microversion: 2.20 time: 0.167027 Nov 12 02:36:07.734168 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 637/1243] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:07 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:08.266090 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6eba1555-3a4a-4ef4-b9be-528a88bf1e75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:08.267115 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6eba1555-3a4a-4ef4-b9be-528a88bf1e75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:08.274760 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6eba1555-3a4a-4ef4-b9be-528a88bf1e75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:08.275208 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6eba1555-3a4a-4ef4-b9be-528a88bf1e75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:08.275993 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6eba1555-3a4a-4ef4-b9be-528a88bf1e75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:08.276427 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6eba1555-3a4a-4ef4-b9be-528a88bf1e75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:08.381394 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6eba1555-3a4a-4ef4-b9be-528a88bf1e75 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.118594 Nov 12 02:36:08.382046 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 607/1244] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:08 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:08.752771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5e44951c-4965-4af4-846e-337a4a076c6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:08.753412 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5e44951c-4965-4af4-846e-337a4a076c6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:08.760777 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5e44951c-4965-4af4-846e-337a4a076c6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:08.761159 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5e44951c-4965-4af4-846e-337a4a076c6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:08.761959 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5e44951c-4965-4af4-846e-337a4a076c6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:08.762395 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5e44951c-4965-4af4-846e-337a4a076c6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:08.899162 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5e44951c-4965-4af4-846e-337a4a076c6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:08.907257 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5e44951c-4965-4af4-846e-337a4a076c6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:08.908819 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5e44951c-4965-4af4-846e-337a4a076c6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:08.910005 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5e44951c-4965-4af4-846e-337a4a076c6a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1743 microversion: 2.20 time: 0.160997 Nov 12 02:36:08.910562 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 638/1245] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:08 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:09.393641 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5a36f16c-9659-4209-9a7d-ff959e6e92d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:09.394864 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5a36f16c-9659-4209-9a7d-ff959e6e92d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:09.402917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a36f16c-9659-4209-9a7d-ff959e6e92d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:09.403364 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a36f16c-9659-4209-9a7d-ff959e6e92d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:09.404156 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a36f16c-9659-4209-9a7d-ff959e6e92d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:09.404590 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5a36f16c-9659-4209-9a7d-ff959e6e92d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:09.495165 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5a36f16c-9659-4209-9a7d-ff959e6e92d6 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.105529 Nov 12 02:36:09.495931 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 608/1246] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:09 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:09.931155 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-dc325c90-0cff-4832-938c-db00970597af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:09.931931 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-dc325c90-0cff-4832-938c-db00970597af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:09.939077 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dc325c90-0cff-4832-938c-db00970597af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:09.939529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dc325c90-0cff-4832-938c-db00970597af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:09.940343 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dc325c90-0cff-4832-938c-db00970597af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:09.940811 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-dc325c90-0cff-4832-938c-db00970597af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:10.218261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-dc325c90-0cff-4832-938c-db00970597af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:10.227403 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-dc325c90-0cff-4832-938c-db00970597af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:10.228913 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-dc325c90-0cff-4832-938c-db00970597af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:10.230090 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-dc325c90-0cff-4832-938c-db00970597af tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1738 microversion: 2.20 time: 0.303712 Nov 12 02:36:10.230939 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 639/1247] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:09 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:10.508464 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-70bedced-1904-42b3-b8da-ce6b54a6d47d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:10.509733 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-70bedced-1904-42b3-b8da-ce6b54a6d47d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:10.518457 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-70bedced-1904-42b3-b8da-ce6b54a6d47d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:10.518944 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-70bedced-1904-42b3-b8da-ce6b54a6d47d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:10.519743 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-70bedced-1904-42b3-b8da-ce6b54a6d47d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:10.520174 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-70bedced-1904-42b3-b8da-ce6b54a6d47d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:10.644569 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-70bedced-1904-42b3-b8da-ce6b54a6d47d tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.140693 Nov 12 02:36:10.645479 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 609/1248] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:10 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:36:11.248936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-54983b4c-9f8e-430b-a921-8fbdb3e0af34 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:11.249527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-54983b4c-9f8e-430b-a921-8fbdb3e0af34 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:11.256173 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-54983b4c-9f8e-430b-a921-8fbdb3e0af34 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:11.256877 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-54983b4c-9f8e-430b-a921-8fbdb3e0af34 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:11.257671 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-54983b4c-9f8e-430b-a921-8fbdb3e0af34 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:11.258399 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-54983b4c-9f8e-430b-a921-8fbdb3e0af34 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:11.403812 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-54983b4c-9f8e-430b-a921-8fbdb3e0af34 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:11.413025 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-54983b4c-9f8e-430b-a921-8fbdb3e0af34 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:11.414418 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-54983b4c-9f8e-430b-a921-8fbdb3e0af34 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:11.415780 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-54983b4c-9f8e-430b-a921-8fbdb3e0af34 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1738 microversion: 2.20 time: 0.170623 Nov 12 02:36:11.426440 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 640/1249] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:11 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:11.659159 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d2c137df-d466-4b1a-b3b8-76ab3720beae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:11.660082 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d2c137df-d466-4b1a-b3b8-76ab3720beae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:11.667140 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2c137df-d466-4b1a-b3b8-76ab3720beae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:11.667586 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2c137df-d466-4b1a-b3b8-76ab3720beae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:11.668619 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2c137df-d466-4b1a-b3b8-76ab3720beae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:11.669057 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2c137df-d466-4b1a-b3b8-76ab3720beae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:11.763594 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d2c137df-d466-4b1a-b3b8-76ab3720beae tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.108553 Nov 12 02:36:11.764270 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 610/1250] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:11 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:12.433211 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-313ef660-9bba-4ea2-b465-a0a8600bddf5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:12.433755 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-313ef660-9bba-4ea2-b465-a0a8600bddf5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:12.440447 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-313ef660-9bba-4ea2-b465-a0a8600bddf5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:12.440893 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-313ef660-9bba-4ea2-b465-a0a8600bddf5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:12.441677 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-313ef660-9bba-4ea2-b465-a0a8600bddf5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:12.442126 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-313ef660-9bba-4ea2-b465-a0a8600bddf5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:12.592033 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-313ef660-9bba-4ea2-b465-a0a8600bddf5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:12.600394 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-313ef660-9bba-4ea2-b465-a0a8600bddf5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:12.601893 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-313ef660-9bba-4ea2-b465-a0a8600bddf5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:12.603101 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-313ef660-9bba-4ea2-b465-a0a8600bddf5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1738 microversion: 2.20 time: 0.173668 Nov 12 02:36:12.603659 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 641/1251] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:12 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:12.777824 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d622919c-7376-4d48-a1a3-5308f8c04664 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:12.778778 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d622919c-7376-4d48-a1a3-5308f8c04664 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:12.786698 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d622919c-7376-4d48-a1a3-5308f8c04664 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:12.787320 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d622919c-7376-4d48-a1a3-5308f8c04664 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:12.788337 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d622919c-7376-4d48-a1a3-5308f8c04664 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:12.788883 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d622919c-7376-4d48-a1a3-5308f8c04664 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:12.904457 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d622919c-7376-4d48-a1a3-5308f8c04664 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.127559 Nov 12 02:36:12.911543 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 611/1252] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:12 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:13.622510 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d3f432df-8e71-41e1-ade6-74fb382c748b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:13.623259 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d3f432df-8e71-41e1-ade6-74fb382c748b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:13.632675 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d3f432df-8e71-41e1-ade6-74fb382c748b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:13.633128 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d3f432df-8e71-41e1-ade6-74fb382c748b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:13.634583 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d3f432df-8e71-41e1-ade6-74fb382c748b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:13.635419 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d3f432df-8e71-41e1-ade6-74fb382c748b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:13.783092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d3f432df-8e71-41e1-ade6-74fb382c748b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:13.795051 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d3f432df-8e71-41e1-ade6-74fb382c748b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:13.797108 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d3f432df-8e71-41e1-ade6-74fb382c748b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:13.798518 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d3f432df-8e71-41e1-ade6-74fb382c748b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1738 microversion: 2.20 time: 0.179638 Nov 12 02:36:13.799143 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 642/1253] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:13 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:13.919672 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7510d5a7-cbb7-4228-9bff-6f238c72d433 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:13.920810 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7510d5a7-cbb7-4228-9bff-6f238c72d433 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:13.933212 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7510d5a7-cbb7-4228-9bff-6f238c72d433 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:13.933656 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7510d5a7-cbb7-4228-9bff-6f238c72d433 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:13.934703 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7510d5a7-cbb7-4228-9bff-6f238c72d433 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:13.935303 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7510d5a7-cbb7-4228-9bff-6f238c72d433 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:14.035757 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7510d5a7-cbb7-4228-9bff-6f238c72d433 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.120003 Nov 12 02:36:14.040570 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 612/1254] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:13 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:14.820082 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1590ce4f-09f3-437b-a693-3f9dc26ea3fe tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:14.820825 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1590ce4f-09f3-437b-a693-3f9dc26ea3fe tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:14.827416 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1590ce4f-09f3-437b-a693-3f9dc26ea3fe tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:14.827879 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1590ce4f-09f3-437b-a693-3f9dc26ea3fe tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:14.828970 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1590ce4f-09f3-437b-a693-3f9dc26ea3fe tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:14.829405 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1590ce4f-09f3-437b-a693-3f9dc26ea3fe tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:14.976365 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1590ce4f-09f3-437b-a693-3f9dc26ea3fe tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:14.984447 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1590ce4f-09f3-437b-a693-3f9dc26ea3fe tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:14.985976 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1590ce4f-09f3-437b-a693-3f9dc26ea3fe tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:14.987199 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1590ce4f-09f3-437b-a693-3f9dc26ea3fe tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1738 microversion: 2.20 time: 0.171471 Nov 12 02:36:14.987763 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 643/1255] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:14 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:15.048474 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-be2a10e9-2aac-43bc-96cc-8209e34f2813 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:15.049861 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-be2a10e9-2aac-43bc-96cc-8209e34f2813 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:15.057896 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be2a10e9-2aac-43bc-96cc-8209e34f2813 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:15.058348 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be2a10e9-2aac-43bc-96cc-8209e34f2813 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:15.059187 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be2a10e9-2aac-43bc-96cc-8209e34f2813 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:15.059781 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be2a10e9-2aac-43bc-96cc-8209e34f2813 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:15.177496 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-be2a10e9-2aac-43bc-96cc-8209e34f2813 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 28665 microversion: 2.1 time: 0.132387 Nov 12 02:36:15.180649 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 613/1256] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:15 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 28665 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:16.010103 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-35f85d0e-605a-4cad-8901-8bb4c9581387 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:16.013686 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-35f85d0e-605a-4cad-8901-8bb4c9581387 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:16.021862 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35f85d0e-605a-4cad-8901-8bb4c9581387 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:16.022738 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35f85d0e-605a-4cad-8901-8bb4c9581387 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:16.023635 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35f85d0e-605a-4cad-8901-8bb4c9581387 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:16.024084 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-35f85d0e-605a-4cad-8901-8bb4c9581387 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:16.181487 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-35f85d0e-605a-4cad-8901-8bb4c9581387 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:16.191682 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-522469cf-ba00-4717-bc03-3a874f65890b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:16.192712 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-522469cf-ba00-4717-bc03-3a874f65890b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:16.194212 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-35f85d0e-605a-4cad-8901-8bb4c9581387 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:16.195936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-35f85d0e-605a-4cad-8901-8bb4c9581387 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:16.197822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-35f85d0e-605a-4cad-8901-8bb4c9581387 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1738 microversion: 2.20 time: 0.194864 Nov 12 02:36:16.198414 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 644/1257] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:16 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:36:16.201380 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-522469cf-ba00-4717-bc03-3a874f65890b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:16.201838 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-522469cf-ba00-4717-bc03-3a874f65890b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:16.202650 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-522469cf-ba00-4717-bc03-3a874f65890b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:16.203616 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-522469cf-ba00-4717-bc03-3a874f65890b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:16.316567 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-522469cf-ba00-4717-bc03-3a874f65890b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 29031 microversion: 2.1 time: 0.129232 Nov 12 02:36:16.317941 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 614/1258] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:16 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 29031 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:36:17.217157 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-82c8a877-d441-4e1a-892e-9e6ddb874509 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:17.218099 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-82c8a877-d441-4e1a-892e-9e6ddb874509 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:17.224921 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-82c8a877-d441-4e1a-892e-9e6ddb874509 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:17.225365 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-82c8a877-d441-4e1a-892e-9e6ddb874509 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:17.226162 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-82c8a877-d441-4e1a-892e-9e6ddb874509 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:17.226585 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-82c8a877-d441-4e1a-892e-9e6ddb874509 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:17.330370 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d82d5421-a7de-4a95-a038-690c55b31586 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:17.331420 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d82d5421-a7de-4a95-a038-690c55b31586 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:17.339604 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d82d5421-a7de-4a95-a038-690c55b31586 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:17.340060 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d82d5421-a7de-4a95-a038-690c55b31586 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:17.340858 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d82d5421-a7de-4a95-a038-690c55b31586 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:17.341299 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d82d5421-a7de-4a95-a038-690c55b31586 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:17.371184 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-82c8a877-d441-4e1a-892e-9e6ddb874509 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:17.379955 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-82c8a877-d441-4e1a-892e-9e6ddb874509 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:17.382122 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-82c8a877-d441-4e1a-892e-9e6ddb874509 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:17.383330 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-82c8a877-d441-4e1a-892e-9e6ddb874509 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1738 microversion: 2.20 time: 0.169904 Nov 12 02:36:17.383885 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 645/1259] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:17 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:17.444562 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d82d5421-a7de-4a95-a038-690c55b31586 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 30972 microversion: 2.1 time: 0.118422 Nov 12 02:36:17.445719 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 615/1260] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:17 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 30972 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:36:18.403247 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0ba741eb-8f60-4226-ba12-0a2e3331a6d4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:18.403796 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0ba741eb-8f60-4226-ba12-0a2e3331a6d4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:18.412561 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0ba741eb-8f60-4226-ba12-0a2e3331a6d4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:18.413139 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0ba741eb-8f60-4226-ba12-0a2e3331a6d4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:18.414016 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0ba741eb-8f60-4226-ba12-0a2e3331a6d4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:18.414513 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0ba741eb-8f60-4226-ba12-0a2e3331a6d4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:18.458253 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-72743466-430d-4bbd-8b92-eeaa4c7c511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:18.460762 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-72743466-430d-4bbd-8b92-eeaa4c7c511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:18.472819 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72743466-430d-4bbd-8b92-eeaa4c7c511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:18.476278 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72743466-430d-4bbd-8b92-eeaa4c7c511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:18.477621 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72743466-430d-4bbd-8b92-eeaa4c7c511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:18.481032 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-72743466-430d-4bbd-8b92-eeaa4c7c511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:18.578310 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0ba741eb-8f60-4226-ba12-0a2e3331a6d4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:18.593204 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0ba741eb-8f60-4226-ba12-0a2e3331a6d4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:18.594714 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0ba741eb-8f60-4226-ba12-0a2e3331a6d4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:18.598353 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0ba741eb-8f60-4226-ba12-0a2e3331a6d4 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1738 microversion: 2.20 time: 0.200311 Nov 12 02:36:18.618301 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-72743466-430d-4bbd-8b92-eeaa4c7c511b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 32735 microversion: 2.1 time: 0.164996 Nov 12 02:36:18.619004 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 616/1261] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:18 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 32735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:18.619331 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 646/1262] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:18 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:19.618629 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-164e5e3e-92bb-43be-b900-a7b15ed60790 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:19.619409 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-164e5e3e-92bb-43be-b900-a7b15ed60790 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:19.626651 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-164e5e3e-92bb-43be-b900-a7b15ed60790 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:19.627504 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-164e5e3e-92bb-43be-b900-a7b15ed60790 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:19.632408 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2ab9c8c1-401f-4078-bc7e-e7213e060c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:19.633314 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2ab9c8c1-401f-4078-bc7e-e7213e060c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:19.639886 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2ab9c8c1-401f-4078-bc7e-e7213e060c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:19.640351 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2ab9c8c1-401f-4078-bc7e-e7213e060c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:19.640861 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-164e5e3e-92bb-43be-b900-a7b15ed60790 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:19.641137 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2ab9c8c1-401f-4078-bc7e-e7213e060c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:19.641311 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-164e5e3e-92bb-43be-b900-a7b15ed60790 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:19.641572 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2ab9c8c1-401f-4078-bc7e-e7213e060c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:19.748838 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2ab9c8c1-401f-4078-bc7e-e7213e060c8b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 33627 microversion: 2.1 time: 0.119653 Nov 12 02:36:19.750333 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 647/1263] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:19 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 33627 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:36:19.857035 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-164e5e3e-92bb-43be-b900-a7b15ed60790 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:19.866226 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-164e5e3e-92bb-43be-b900-a7b15ed60790 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:19.869590 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-164e5e3e-92bb-43be-b900-a7b15ed60790 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:19.870988 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-164e5e3e-92bb-43be-b900-a7b15ed60790 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1738 microversion: 2.20 time: 0.257340 Nov 12 02:36:19.874485 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 617/1264] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:19 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:36:20.763112 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5d12a269-55be-493e-8b96-877bcf7bba0f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:20.764824 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5d12a269-55be-493e-8b96-877bcf7bba0f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:20.773698 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d12a269-55be-493e-8b96-877bcf7bba0f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:20.774154 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d12a269-55be-493e-8b96-877bcf7bba0f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:20.774992 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d12a269-55be-493e-8b96-877bcf7bba0f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:20.775463 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5d12a269-55be-493e-8b96-877bcf7bba0f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:20.888336 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5d12a269-55be-493e-8b96-877bcf7bba0f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 34845 microversion: 2.1 time: 0.129584 Nov 12 02:36:20.888968 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 648/1265] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:20 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 34845 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:21.040004 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d88f0bd9-9213-4819-b9ec-8844daea83fd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:21.040728 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d88f0bd9-9213-4819-b9ec-8844daea83fd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:21.050039 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d88f0bd9-9213-4819-b9ec-8844daea83fd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:21.050039 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d88f0bd9-9213-4819-b9ec-8844daea83fd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:21.050039 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d88f0bd9-9213-4819-b9ec-8844daea83fd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:21.050039 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d88f0bd9-9213-4819-b9ec-8844daea83fd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:21.052128 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:36:21.052867 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: Fri Nov 12 02:36:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd (ip 10.222.0.70) !!! Nov 12 02:36:21.214841 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d88f0bd9-9213-4819-b9ec-8844daea83fd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:21.225560 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d88f0bd9-9213-4819-b9ec-8844daea83fd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:21.227139 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d88f0bd9-9213-4819-b9ec-8844daea83fd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:21.228358 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d88f0bd9-9213-4819-b9ec-8844daea83fd tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1738 microversion: 2.20 time: 0.342957 Nov 12 02:36:21.228921 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 618/1266] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:20 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1738 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:36:21.901361 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d1977976-e082-44e0-bebc-61689e116c56 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:21.903471 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d1977976-e082-44e0-bebc-61689e116c56 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:21.912019 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1977976-e082-44e0-bebc-61689e116c56 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:21.912877 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1977976-e082-44e0-bebc-61689e116c56 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:21.913889 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1977976-e082-44e0-bebc-61689e116c56 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:21.914335 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1977976-e082-44e0-bebc-61689e116c56 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:22.024841 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d1977976-e082-44e0-bebc-61689e116c56 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 35891 microversion: 2.1 time: 0.127748 Nov 12 02:36:22.026146 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 649/1267] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:21 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 35891 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:22.246644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-87a3defd-8a51-44c3-abec-7b6dfc135b4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:22.247281 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-87a3defd-8a51-44c3-abec-7b6dfc135b4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:22.254107 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-87a3defd-8a51-44c3-abec-7b6dfc135b4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:22.254561 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-87a3defd-8a51-44c3-abec-7b6dfc135b4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:22.255411 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-87a3defd-8a51-44c3-abec-7b6dfc135b4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:22.255910 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-87a3defd-8a51-44c3-abec-7b6dfc135b4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:22.417812 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-87a3defd-8a51-44c3-abec-7b6dfc135b4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:22.429067 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-87a3defd-8a51-44c3-abec-7b6dfc135b4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:22.432132 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-87a3defd-8a51-44c3-abec-7b6dfc135b4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:22.434064 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-87a3defd-8a51-44c3-abec-7b6dfc135b4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1738 microversion: 2.20 time: 0.190737 Nov 12 02:36:22.435067 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 619/1268] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:22 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:23.038465 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-43e2735c-0973-4144-a70a-3b997497dcbf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:23.039645 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-43e2735c-0973-4144-a70a-3b997497dcbf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:23.046437 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-43e2735c-0973-4144-a70a-3b997497dcbf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:23.046947 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-43e2735c-0973-4144-a70a-3b997497dcbf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:23.047758 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-43e2735c-0973-4144-a70a-3b997497dcbf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:23.048194 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-43e2735c-0973-4144-a70a-3b997497dcbf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:23.146995 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-43e2735c-0973-4144-a70a-3b997497dcbf tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 37252 microversion: 2.1 time: 0.112535 Nov 12 02:36:23.152343 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 650/1269] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:23 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 37252 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 12 02:36:23.452672 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b8f592f0-7a8f-49eb-a263-c4b0aa1957ae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:23.453280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b8f592f0-7a8f-49eb-a263-c4b0aa1957ae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:23.459557 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b8f592f0-7a8f-49eb-a263-c4b0aa1957ae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:23.460007 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b8f592f0-7a8f-49eb-a263-c4b0aa1957ae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:23.460830 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b8f592f0-7a8f-49eb-a263-c4b0aa1957ae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:23.461253 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-b8f592f0-7a8f-49eb-a263-c4b0aa1957ae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:23.600231 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b8f592f0-7a8f-49eb-a263-c4b0aa1957ae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:23.608396 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b8f592f0-7a8f-49eb-a263-c4b0aa1957ae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:23.609882 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b8f592f0-7a8f-49eb-a263-c4b0aa1957ae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:23.611100 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b8f592f0-7a8f-49eb-a263-c4b0aa1957ae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1738 microversion: 2.20 time: 0.162168 Nov 12 02:36:23.611647 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 620/1270] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:23 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:24.160670 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-85ed64fd-7023-4304-b946-fd8fb237d04a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:24.162184 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-85ed64fd-7023-4304-b946-fd8fb237d04a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:24.169529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-85ed64fd-7023-4304-b946-fd8fb237d04a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:24.169979 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-85ed64fd-7023-4304-b946-fd8fb237d04a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:24.170795 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-85ed64fd-7023-4304-b946-fd8fb237d04a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:24.171231 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-85ed64fd-7023-4304-b946-fd8fb237d04a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:24.295390 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-85ed64fd-7023-4304-b946-fd8fb237d04a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 38195 microversion: 2.1 time: 0.138629 Nov 12 02:36:24.296044 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 651/1271] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:24 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 38195 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:24.629895 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e607b6de-e45e-46c3-9e13-6e8e141f646f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:24.630524 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e607b6de-e45e-46c3-9e13-6e8e141f646f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:24.636640 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e607b6de-e45e-46c3-9e13-6e8e141f646f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:24.637091 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e607b6de-e45e-46c3-9e13-6e8e141f646f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:24.637891 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e607b6de-e45e-46c3-9e13-6e8e141f646f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:24.638321 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e607b6de-e45e-46c3-9e13-6e8e141f646f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:24.891123 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e607b6de-e45e-46c3-9e13-6e8e141f646f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:24.899525 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e607b6de-e45e-46c3-9e13-6e8e141f646f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:24.901020 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e607b6de-e45e-46c3-9e13-6e8e141f646f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:24.902219 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e607b6de-e45e-46c3-9e13-6e8e141f646f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1720 microversion: 2.20 time: 0.276012 Nov 12 02:36:24.902809 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 621/1272] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:24 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1720 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:25.309248 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-feb8e8eb-2f5f-460a-9f46-30c58ecf9927 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:25.310250 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-feb8e8eb-2f5f-460a-9f46-30c58ecf9927 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:25.317239 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-feb8e8eb-2f5f-460a-9f46-30c58ecf9927 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:25.318244 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-feb8e8eb-2f5f-460a-9f46-30c58ecf9927 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:25.319065 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-feb8e8eb-2f5f-460a-9f46-30c58ecf9927 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:25.319503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-feb8e8eb-2f5f-460a-9f46-30c58ecf9927 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:25.407678 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-feb8e8eb-2f5f-460a-9f46-30c58ecf9927 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 38195 microversion: 2.1 time: 0.102601 Nov 12 02:36:25.408260 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 652/1273] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:25 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 38195 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:25.921248 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-26f4051a-3e6f-49e2-a9a8-663f4c70170d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:25.921837 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-26f4051a-3e6f-49e2-a9a8-663f4c70170d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:25.928837 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26f4051a-3e6f-49e2-a9a8-663f4c70170d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:25.929283 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26f4051a-3e6f-49e2-a9a8-663f4c70170d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:25.930066 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26f4051a-3e6f-49e2-a9a8-663f4c70170d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:25.930497 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-26f4051a-3e6f-49e2-a9a8-663f4c70170d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:26.077084 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-26f4051a-3e6f-49e2-a9a8-663f4c70170d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:26.085915 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-26f4051a-3e6f-49e2-a9a8-663f4c70170d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:26.087465 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-26f4051a-3e6f-49e2-a9a8-663f4c70170d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:26.088663 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-26f4051a-3e6f-49e2-a9a8-663f4c70170d tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1720 microversion: 2.20 time: 0.171211 Nov 12 02:36:26.089211 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 622/1274] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:25 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:26.420116 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ceec9f67-1763-48ae-be39-b579fb2d5fef tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:26.421246 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ceec9f67-1763-48ae-be39-b579fb2d5fef tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:26.429117 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ceec9f67-1763-48ae-be39-b579fb2d5fef tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:26.429570 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ceec9f67-1763-48ae-be39-b579fb2d5fef tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:26.430365 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ceec9f67-1763-48ae-be39-b579fb2d5fef tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:26.430841 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ceec9f67-1763-48ae-be39-b579fb2d5fef tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:26.493912 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-ac31b69c-2ed1-4394-9329-a6d247d074cc req-c0f29289-707f-463f-af17-32accf93841c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75cfef8-bb7c-41d9-b969-d4f2454a64fd", "name": "network-vif-unplugged", "status": "completed", "tag": "054e67ae-3cc3-4cc3-b945-349581ab03eb"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:26.495517 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:36:26.495517 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:36:26.502420 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-ac31b69c-2ed1-4394-9329-a6d247d074cc req-c0f29289-707f-463f-af17-32accf93841c service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:26.502890 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-ac31b69c-2ed1-4394-9329-a6d247d074cc req-c0f29289-707f-463f-af17-32accf93841c service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:26.515052 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-ac31b69c-2ed1-4394-9329-a6d247d074cc req-c0f29289-707f-463f-af17-32accf93841c service nova] Creating event network-vif-unplugged:054e67ae-3cc3-4cc3-b945-349581ab03eb for instance d75cfef8-bb7c-41d9-b969-d4f2454a64fd on hv-cinder-80857 Nov 12 02:36:26.520267 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-ac31b69c-2ed1-4394-9329-a6d247d074cc req-c0f29289-707f-463f-af17-32accf93841c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030744 Nov 12 02:36:26.520851 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 623/1275] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:36:26 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:36:26.610127 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ceec9f67-1763-48ae-be39-b579fb2d5fef tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 38195 microversion: 2.1 time: 0.194037 Nov 12 02:36:26.610817 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 653/1276] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:26 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 38195 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:27.108716 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f1354e60-75e6-4084-bbe5-a89a1c9d2445 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:27.109416 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f1354e60-75e6-4084-bbe5-a89a1c9d2445 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:27.116472 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1354e60-75e6-4084-bbe5-a89a1c9d2445 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:27.117175 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1354e60-75e6-4084-bbe5-a89a1c9d2445 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:27.117986 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1354e60-75e6-4084-bbe5-a89a1c9d2445 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:27.118418 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1354e60-75e6-4084-bbe5-a89a1c9d2445 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:27.271329 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f1354e60-75e6-4084-bbe5-a89a1c9d2445 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:27.280348 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f1354e60-75e6-4084-bbe5-a89a1c9d2445 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:27.281099 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f1354e60-75e6-4084-bbe5-a89a1c9d2445 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:27.282261 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f1354e60-75e6-4084-bbe5-a89a1c9d2445 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1723 microversion: 2.20 time: 0.178074 Nov 12 02:36:27.282848 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 624/1277] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:27 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:36:27.303300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fb210fe8-5dc5-45af-8541-ba7ecc72afdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b5ac88d-56cf-4c73-ad15-97abe95fa418"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:27.304544 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-fb210fe8-5dc5-45af-8541-ba7ecc72afdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:27.311619 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fb210fe8-5dc5-45af-8541-ba7ecc72afdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:27.312063 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fb210fe8-5dc5-45af-8541-ba7ecc72afdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:27.312842 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fb210fe8-5dc5-45af-8541-ba7ecc72afdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:27.313278 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fb210fe8-5dc5-45af-8541-ba7ecc72afdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:27.613082 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-fb210fe8-5dc5-45af-8541-ba7ecc72afdc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.316852 Nov 12 02:36:27.613790 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 654/1278] 10.222.0.70 () {62 vars in 1363 bytes} [Fri Nov 12 02:36:27 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:27.624526 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-38b857a4-56d1-4c47-b41c-d324f9450c7a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:27.625481 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-38b857a4-56d1-4c47-b41c-d324f9450c7a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:27.631879 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-38b857a4-56d1-4c47-b41c-d324f9450c7a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:27.632370 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-38b857a4-56d1-4c47-b41c-d324f9450c7a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:27.633116 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-38b857a4-56d1-4c47-b41c-d324f9450c7a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:27.633548 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-38b857a4-56d1-4c47-b41c-d324f9450c7a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:27.727050 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a9c80061-4944-4798-b6db-3858d7d227e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:27.727543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a9c80061-4944-4798-b6db-3858d7d227e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:27.733719 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a9c80061-4944-4798-b6db-3858d7d227e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:27.734006 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a9c80061-4944-4798-b6db-3858d7d227e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:27.734818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a9c80061-4944-4798-b6db-3858d7d227e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:27.735250 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a9c80061-4944-4798-b6db-3858d7d227e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:27.746934 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-38b857a4-56d1-4c47-b41c-d324f9450c7a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action" status: 200 len: 38326 microversion: 2.1 time: 0.125870 Nov 12 02:36:27.752462 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 625/1279] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:36:27 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/action => generated 38326 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 12 02:36:27.759030 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-caed1358-fb38-4a80-93c2-12d803823d14 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:27.759780 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-caed1358-fb38-4a80-93c2-12d803823d14 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:27.767854 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-caed1358-fb38-4a80-93c2-12d803823d14 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:27.768393 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-caed1358-fb38-4a80-93c2-12d803823d14 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:27.769551 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-caed1358-fb38-4a80-93c2-12d803823d14 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:27.769947 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-caed1358-fb38-4a80-93c2-12d803823d14 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:27.795249 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-caed1358-fb38-4a80-93c2-12d803823d14 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/ips" status: 200 len: 146 microversion: 2.1 time: 0.041226 Nov 12 02:36:27.795846 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 626/1280] 10.222.0.70 () {58 vars in 1247 bytes} [Fri Nov 12 02:36:27 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:36:27.999705 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a9c80061-4944-4798-b6db-3858d7d227e3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/os-volume_attachments/6b5ac88d-56cf-4c73-ad15-97abe95fa418" status: 202 len: 0 microversion: 2.20 time: 0.276648 Nov 12 02:36:28.000318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 655/1281] 10.222.0.70 () {60 vars in 1456 bytes} [Fri Nov 12 02:36:27 2021] DELETE /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/os-volume_attachments/6b5ac88d-56cf-4c73-ad15-97abe95fa418 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 12 02:36:28.075673 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ce7d2551-3cee-4fa4-82c4-813e4254a257 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:28.076236 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ce7d2551-3cee-4fa4-82c4-813e4254a257 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:28.085649 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce7d2551-3cee-4fa4-82c4-813e4254a257 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:28.086205 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce7d2551-3cee-4fa4-82c4-813e4254a257 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:28.087112 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce7d2551-3cee-4fa4-82c4-813e4254a257 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:28.087723 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce7d2551-3cee-4fa4-82c4-813e4254a257 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:28.193975 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ce7d2551-3cee-4fa4-82c4-813e4254a257 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action" status: 202 len: 0 microversion: 2.20 time: 0.121993 Nov 12 02:36:28.194890 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 627/1282] 10.222.0.70 () {62 vars in 1318 bytes} [Fri Nov 12 02:36:28 2021] POST /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:36:28.203581 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-48ff0c75-03db-47f1-bbbc-d1c2f8f0c006 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:28.204543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-48ff0c75-03db-47f1-bbbc-d1c2f8f0c006 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:28.213315 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-48ff0c75-03db-47f1-bbbc-d1c2f8f0c006 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:28.213813 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-48ff0c75-03db-47f1-bbbc-d1c2f8f0c006 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:28.214762 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-48ff0c75-03db-47f1-bbbc-d1c2f8f0c006 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:28.215263 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-48ff0c75-03db-47f1-bbbc-d1c2f8f0c006 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:28.353822 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-48ff0c75-03db-47f1-bbbc-d1c2f8f0c006 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:28.362270 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-48ff0c75-03db-47f1-bbbc-d1c2f8f0c006 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:28.366404 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-48ff0c75-03db-47f1-bbbc-d1c2f8f0c006 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:28.368034 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-48ff0c75-03db-47f1-bbbc-d1c2f8f0c006 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1671 microversion: 2.20 time: 0.168408 Nov 12 02:36:28.368597 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 656/1283] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:28 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:29.141842 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-62e1b78a-5344-4ee9-918d-58e6068f6d11 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dd05ec9-9bfd-4358-94b1-1acc0189f262"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:29.143435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-62e1b78a-5344-4ee9-918d-58e6068f6d11 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:29.154582 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62e1b78a-5344-4ee9-918d-58e6068f6d11 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:29.155206 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62e1b78a-5344-4ee9-918d-58e6068f6d11 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:29.156157 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62e1b78a-5344-4ee9-918d-58e6068f6d11 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:29.156689 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-62e1b78a-5344-4ee9-918d-58e6068f6d11 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:29.387699 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-cf4e08af-2e96-4fa4-9a30-f3bc44e27583 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:29.388488 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-cf4e08af-2e96-4fa4-9a30-f3bc44e27583 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:29.394921 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cf4e08af-2e96-4fa4-9a30-f3bc44e27583 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:29.395373 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cf4e08af-2e96-4fa4-9a30-f3bc44e27583 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:29.396186 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cf4e08af-2e96-4fa4-9a30-f3bc44e27583 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:29.396620 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cf4e08af-2e96-4fa4-9a30-f3bc44e27583 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:29.449556 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-62e1b78a-5344-4ee9-918d-58e6068f6d11 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312007 Nov 12 02:36:29.450913 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 628/1284] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:36:29 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:36:29.647514 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cf4e08af-2e96-4fa4-9a30-f3bc44e27583 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:29.655824 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cf4e08af-2e96-4fa4-9a30-f3bc44e27583 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:29.657770 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cf4e08af-2e96-4fa4-9a30-f3bc44e27583 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:29.659113 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-cf4e08af-2e96-4fa4-9a30-f3bc44e27583 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.275260 Nov 12 02:36:29.659965 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 657/1285] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:29 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:36:30.678447 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e63d5663-2144-4205-97ef-7709cb65f882 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:30.679442 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e63d5663-2144-4205-97ef-7709cb65f882 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:30.686541 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e63d5663-2144-4205-97ef-7709cb65f882 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:30.687108 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e63d5663-2144-4205-97ef-7709cb65f882 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:30.688018 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e63d5663-2144-4205-97ef-7709cb65f882 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:30.688437 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e63d5663-2144-4205-97ef-7709cb65f882 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:30.849324 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e63d5663-2144-4205-97ef-7709cb65f882 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:30.857384 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e63d5663-2144-4205-97ef-7709cb65f882 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:30.858933 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e63d5663-2144-4205-97ef-7709cb65f882 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:30.860100 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e63d5663-2144-4205-97ef-7709cb65f882 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.186505 Nov 12 02:36:30.860659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 629/1286] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:30 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:31.878528 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-69fcf767-0472-4e93-91cd-ac468a11808b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:31.879313 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-69fcf767-0472-4e93-91cd-ac468a11808b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:31.886820 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-69fcf767-0472-4e93-91cd-ac468a11808b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:31.887275 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-69fcf767-0472-4e93-91cd-ac468a11808b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:31.888066 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-69fcf767-0472-4e93-91cd-ac468a11808b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:31.888503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-69fcf767-0472-4e93-91cd-ac468a11808b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:32.050421 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-69fcf767-0472-4e93-91cd-ac468a11808b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:32.060104 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-69fcf767-0472-4e93-91cd-ac468a11808b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:32.061620 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-69fcf767-0472-4e93-91cd-ac468a11808b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:32.062836 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-69fcf767-0472-4e93-91cd-ac468a11808b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.187999 Nov 12 02:36:32.063396 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 658/1287] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:31 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:33.081767 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ec0dfcda-8591-4782-ac74-d6b7bd3dab4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:33.082479 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ec0dfcda-8591-4782-ac74-d6b7bd3dab4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:33.089341 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec0dfcda-8591-4782-ac74-d6b7bd3dab4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:33.089945 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec0dfcda-8591-4782-ac74-d6b7bd3dab4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:33.090881 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec0dfcda-8591-4782-ac74-d6b7bd3dab4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:33.091606 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ec0dfcda-8591-4782-ac74-d6b7bd3dab4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:33.266179 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ec0dfcda-8591-4782-ac74-d6b7bd3dab4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:33.274761 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ec0dfcda-8591-4782-ac74-d6b7bd3dab4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:33.276281 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ec0dfcda-8591-4782-ac74-d6b7bd3dab4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:33.277458 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ec0dfcda-8591-4782-ac74-d6b7bd3dab4a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.199646 Nov 12 02:36:33.278020 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 630/1288] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:33 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:34.296222 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-cccd955a-1a97-4b3c-8642-98ce569a5ec5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:34.296818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-cccd955a-1a97-4b3c-8642-98ce569a5ec5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:34.303753 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cccd955a-1a97-4b3c-8642-98ce569a5ec5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:34.304210 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cccd955a-1a97-4b3c-8642-98ce569a5ec5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:34.304996 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cccd955a-1a97-4b3c-8642-98ce569a5ec5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:34.305436 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cccd955a-1a97-4b3c-8642-98ce569a5ec5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:34.453980 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cccd955a-1a97-4b3c-8642-98ce569a5ec5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:34.463012 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cccd955a-1a97-4b3c-8642-98ce569a5ec5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:34.464532 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cccd955a-1a97-4b3c-8642-98ce569a5ec5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:34.465738 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-cccd955a-1a97-4b3c-8642-98ce569a5ec5 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.173297 Nov 12 02:36:34.466302 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 659/1289] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:34 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:35.484638 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cf2c8b5f-02d3-48c5-b68e-e4bfb981d5cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:35.485183 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cf2c8b5f-02d3-48c5-b68e-e4bfb981d5cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:35.491596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf2c8b5f-02d3-48c5-b68e-e4bfb981d5cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:35.492309 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf2c8b5f-02d3-48c5-b68e-e4bfb981d5cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:35.493101 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf2c8b5f-02d3-48c5-b68e-e4bfb981d5cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:35.493543 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cf2c8b5f-02d3-48c5-b68e-e4bfb981d5cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:35.637511 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cf2c8b5f-02d3-48c5-b68e-e4bfb981d5cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:35.646491 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cf2c8b5f-02d3-48c5-b68e-e4bfb981d5cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:35.648086 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cf2c8b5f-02d3-48c5-b68e-e4bfb981d5cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:35.649264 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cf2c8b5f-02d3-48c5-b68e-e4bfb981d5cf tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.168446 Nov 12 02:36:35.649824 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 631/1290] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:35 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:36.667630 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0ab21406-7f18-4bd5-bde5-d33a902f736c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:36.668299 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0ab21406-7f18-4bd5-bde5-d33a902f736c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:36.674750 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0ab21406-7f18-4bd5-bde5-d33a902f736c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:36.675222 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0ab21406-7f18-4bd5-bde5-d33a902f736c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:36.675997 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0ab21406-7f18-4bd5-bde5-d33a902f736c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:36.676435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0ab21406-7f18-4bd5-bde5-d33a902f736c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:36.815210 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0ab21406-7f18-4bd5-bde5-d33a902f736c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:36.824798 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0ab21406-7f18-4bd5-bde5-d33a902f736c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:36.826772 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0ab21406-7f18-4bd5-bde5-d33a902f736c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:36.827963 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0ab21406-7f18-4bd5-bde5-d33a902f736c tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.164108 Nov 12 02:36:36.828516 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 660/1291] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:36 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:36:37.847050 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dcfff4e8-3c9e-4d32-a750-9e2cdb644e70 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:37.847702 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dcfff4e8-3c9e-4d32-a750-9e2cdb644e70 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:37.854722 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dcfff4e8-3c9e-4d32-a750-9e2cdb644e70 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:37.855180 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dcfff4e8-3c9e-4d32-a750-9e2cdb644e70 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:37.855971 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dcfff4e8-3c9e-4d32-a750-9e2cdb644e70 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:37.856407 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dcfff4e8-3c9e-4d32-a750-9e2cdb644e70 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:38.278011 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dcfff4e8-3c9e-4d32-a750-9e2cdb644e70 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:38.286722 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dcfff4e8-3c9e-4d32-a750-9e2cdb644e70 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:38.287864 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dcfff4e8-3c9e-4d32-a750-9e2cdb644e70 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:38.289055 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dcfff4e8-3c9e-4d32-a750-9e2cdb644e70 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.445778 Nov 12 02:36:38.289903 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 632/1292] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:37 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:39.307475 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3b82f0d3-0227-48d7-99b6-88424b1deff7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:39.308100 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3b82f0d3-0227-48d7-99b6-88424b1deff7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:39.314291 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3b82f0d3-0227-48d7-99b6-88424b1deff7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:39.314811 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3b82f0d3-0227-48d7-99b6-88424b1deff7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:39.315598 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3b82f0d3-0227-48d7-99b6-88424b1deff7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:39.316041 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3b82f0d3-0227-48d7-99b6-88424b1deff7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:39.480944 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3b82f0d3-0227-48d7-99b6-88424b1deff7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:39.489935 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3b82f0d3-0227-48d7-99b6-88424b1deff7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:39.491899 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3b82f0d3-0227-48d7-99b6-88424b1deff7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:39.493248 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3b82f0d3-0227-48d7-99b6-88424b1deff7 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.189581 Nov 12 02:36:39.494223 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 661/1293] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:39 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:40.512403 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-347298f1-af54-4a4c-8b23-244be547c8d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:40.513302 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-347298f1-af54-4a4c-8b23-244be547c8d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:40.520139 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-347298f1-af54-4a4c-8b23-244be547c8d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:40.521171 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-347298f1-af54-4a4c-8b23-244be547c8d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:40.521989 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-347298f1-af54-4a4c-8b23-244be547c8d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:40.522429 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-347298f1-af54-4a4c-8b23-244be547c8d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:40.672630 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-347298f1-af54-4a4c-8b23-244be547c8d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:40.686579 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-347298f1-af54-4a4c-8b23-244be547c8d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:40.688133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-347298f1-af54-4a4c-8b23-244be547c8d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:40.689284 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-347298f1-af54-4a4c-8b23-244be547c8d3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.181339 Nov 12 02:36:40.689841 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 633/1294] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:40 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:41.708923 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-258cfba0-9290-48d1-81c8-f3ae6dfbb461 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:41.709547 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-258cfba0-9290-48d1-81c8-f3ae6dfbb461 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:41.716298 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-258cfba0-9290-48d1-81c8-f3ae6dfbb461 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:41.716744 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-258cfba0-9290-48d1-81c8-f3ae6dfbb461 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:41.717543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-258cfba0-9290-48d1-81c8-f3ae6dfbb461 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:41.718061 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-258cfba0-9290-48d1-81c8-f3ae6dfbb461 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:41.859935 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-258cfba0-9290-48d1-81c8-f3ae6dfbb461 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:41.868426 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-258cfba0-9290-48d1-81c8-f3ae6dfbb461 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:41.869931 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-258cfba0-9290-48d1-81c8-f3ae6dfbb461 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:41.871155 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-258cfba0-9290-48d1-81c8-f3ae6dfbb461 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.166538 Nov 12 02:36:41.871723 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 662/1295] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:41 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:42.890695 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8b98ce97-fc11-4a05-85d6-3b634880983b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:42.891401 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8b98ce97-fc11-4a05-85d6-3b634880983b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:42.898342 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b98ce97-fc11-4a05-85d6-3b634880983b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:42.898822 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b98ce97-fc11-4a05-85d6-3b634880983b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:42.899714 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b98ce97-fc11-4a05-85d6-3b634880983b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:42.900152 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b98ce97-fc11-4a05-85d6-3b634880983b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:43.067972 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8b98ce97-fc11-4a05-85d6-3b634880983b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:43.076492 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8b98ce97-fc11-4a05-85d6-3b634880983b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:43.078022 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8b98ce97-fc11-4a05-85d6-3b634880983b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:43.079281 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8b98ce97-fc11-4a05-85d6-3b634880983b tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.193673 Nov 12 02:36:43.087459 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 634/1296] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:42 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:44.099244 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7a5fb403-3ce7-428c-aa4e-8aa1ea601584 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:44.099832 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7a5fb403-3ce7-428c-aa4e-8aa1ea601584 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:44.106289 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7a5fb403-3ce7-428c-aa4e-8aa1ea601584 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:44.106772 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7a5fb403-3ce7-428c-aa4e-8aa1ea601584 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:44.107713 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7a5fb403-3ce7-428c-aa4e-8aa1ea601584 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:44.108289 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7a5fb403-3ce7-428c-aa4e-8aa1ea601584 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:44.272683 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7a5fb403-3ce7-428c-aa4e-8aa1ea601584 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:44.280806 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7a5fb403-3ce7-428c-aa4e-8aa1ea601584 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:44.282308 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7a5fb403-3ce7-428c-aa4e-8aa1ea601584 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:44.283562 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7a5fb403-3ce7-428c-aa4e-8aa1ea601584 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.188752 Nov 12 02:36:44.284121 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 663/1297] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:44 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:45.302598 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a8d90a85-e01b-4aff-bfbb-3255dea70844 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:45.303260 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a8d90a85-e01b-4aff-bfbb-3255dea70844 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:45.309899 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8d90a85-e01b-4aff-bfbb-3255dea70844 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:45.310343 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8d90a85-e01b-4aff-bfbb-3255dea70844 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:45.311178 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8d90a85-e01b-4aff-bfbb-3255dea70844 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:45.311609 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8d90a85-e01b-4aff-bfbb-3255dea70844 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:45.481301 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a8d90a85-e01b-4aff-bfbb-3255dea70844 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:45.489366 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a8d90a85-e01b-4aff-bfbb-3255dea70844 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:45.491078 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a8d90a85-e01b-4aff-bfbb-3255dea70844 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:45.492624 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a8d90a85-e01b-4aff-bfbb-3255dea70844 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.194266 Nov 12 02:36:45.493283 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 635/1298] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:45 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:46.512110 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4bb1d3f7-77f9-43b2-9fc3-4f53ca81de11 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:46.512844 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4bb1d3f7-77f9-43b2-9fc3-4f53ca81de11 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:46.519736 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4bb1d3f7-77f9-43b2-9fc3-4f53ca81de11 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:46.520757 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4bb1d3f7-77f9-43b2-9fc3-4f53ca81de11 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:46.521536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4bb1d3f7-77f9-43b2-9fc3-4f53ca81de11 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:46.521962 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4bb1d3f7-77f9-43b2-9fc3-4f53ca81de11 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:46.659256 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4bb1d3f7-77f9-43b2-9fc3-4f53ca81de11 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:46.667526 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4bb1d3f7-77f9-43b2-9fc3-4f53ca81de11 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:46.669027 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4bb1d3f7-77f9-43b2-9fc3-4f53ca81de11 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:46.670194 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4bb1d3f7-77f9-43b2-9fc3-4f53ca81de11 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.162089 Nov 12 02:36:46.670851 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 664/1299] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:46 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:47.689162 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-5dd40808-9212-48ae-8c56-30f668e93ee3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:47.689747 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-5dd40808-9212-48ae-8c56-30f668e93ee3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:47.696200 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5dd40808-9212-48ae-8c56-30f668e93ee3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:47.696654 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5dd40808-9212-48ae-8c56-30f668e93ee3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:47.697432 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5dd40808-9212-48ae-8c56-30f668e93ee3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:47.697882 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-5dd40808-9212-48ae-8c56-30f668e93ee3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:47.836493 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5dd40808-9212-48ae-8c56-30f668e93ee3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:47.844419 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5dd40808-9212-48ae-8c56-30f668e93ee3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:47.845927 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-5dd40808-9212-48ae-8c56-30f668e93ee3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:47.847102 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-5dd40808-9212-48ae-8c56-30f668e93ee3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.161725 Nov 12 02:36:47.847659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 636/1300] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:47 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:48.865564 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4a044165-159d-43c5-8509-df754c6d3da9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:48.866316 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4a044165-159d-43c5-8509-df754c6d3da9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:48.872878 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a044165-159d-43c5-8509-df754c6d3da9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:48.873334 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a044165-159d-43c5-8509-df754c6d3da9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:48.874120 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a044165-159d-43c5-8509-df754c6d3da9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:48.874557 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4a044165-159d-43c5-8509-df754c6d3da9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:49.005648 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4a044165-159d-43c5-8509-df754c6d3da9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:49.013449 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4a044165-159d-43c5-8509-df754c6d3da9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:49.014986 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4a044165-159d-43c5-8509-df754c6d3da9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:49.016137 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4a044165-159d-43c5-8509-df754c6d3da9 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.154465 Nov 12 02:36:49.016702 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 665/1301] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:48 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:49.693594 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6651a253-0dfa-4597-a926-0e50fc1a0cd5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:49.694952 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6651a253-0dfa-4597-a926-0e50fc1a0cd5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:49.700917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6651a253-0dfa-4597-a926-0e50fc1a0cd5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:49.701366 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6651a253-0dfa-4597-a926-0e50fc1a0cd5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:49.702141 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6651a253-0dfa-4597-a926-0e50fc1a0cd5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:49.702574 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6651a253-0dfa-4597-a926-0e50fc1a0cd5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:49.730497 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6651a253-0dfa-4597-a926-0e50fc1a0cd5 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 Nov 12 02:36:49.731084 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 637/1302] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:36:49 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:36:49.741144 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ab5d41de-0d59-4399-ac3f-7951124ba594 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:49.741625 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ab5d41de-0d59-4399-ac3f-7951124ba594 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:49.747616 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ab5d41de-0d59-4399-ac3f-7951124ba594 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:49.748058 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ab5d41de-0d59-4399-ac3f-7951124ba594 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:49.748827 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ab5d41de-0d59-4399-ac3f-7951124ba594 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:49.749257 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ab5d41de-0d59-4399-ac3f-7951124ba594 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:49.778686 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ab5d41de-0d59-4399-ac3f-7951124ba594 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments/7dd05ec9-9bfd-4358-94b1-1acc0189f262" status: 200 len: 194 microversion: 2.1 time: 0.041724 Nov 12 02:36:49.779260 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 666/1303] 10.222.0.70 () {58 vars in 1412 bytes} [Fri Nov 12 02:36:49 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments/7dd05ec9-9bfd-4358-94b1-1acc0189f262 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:36:50.033447 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0ec03fb8-b671-4321-abfa-c869db8befb3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:50.034056 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0ec03fb8-b671-4321-abfa-c869db8befb3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:50.040121 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ec03fb8-b671-4321-abfa-c869db8befb3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:50.040573 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ec03fb8-b671-4321-abfa-c869db8befb3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:50.041354 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ec03fb8-b671-4321-abfa-c869db8befb3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:50.041821 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0ec03fb8-b671-4321-abfa-c869db8befb3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:50.179837 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0ec03fb8-b671-4321-abfa-c869db8befb3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:50.188043 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0ec03fb8-b671-4321-abfa-c869db8befb3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:50.189549 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0ec03fb8-b671-4321-abfa-c869db8befb3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:50.190794 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0ec03fb8-b671-4321-abfa-c869db8befb3 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.161161 Nov 12 02:36:50.191383 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 638/1304] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:50 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:51.083300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fd6576d7-a826-411f-ba82-1b0c02e91f25 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25dff7cd-6b5e-4005-83f0-8c0ae4444a7a"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:51.084426 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-fd6576d7-a826-411f-ba82-1b0c02e91f25 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:51.090883 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd6576d7-a826-411f-ba82-1b0c02e91f25 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:51.091330 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd6576d7-a826-411f-ba82-1b0c02e91f25 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:51.092113 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd6576d7-a826-411f-ba82-1b0c02e91f25 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:51.092542 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd6576d7-a826-411f-ba82-1b0c02e91f25 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:51.209736 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-2dcf108d-91b2-42b8-b094-bae63e2eceb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:51.211123 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-2dcf108d-91b2-42b8-b094-bae63e2eceb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:51.217981 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2dcf108d-91b2-42b8-b094-bae63e2eceb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:51.218472 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2dcf108d-91b2-42b8-b094-bae63e2eceb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:51.219258 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2dcf108d-91b2-42b8-b094-bae63e2eceb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:51.219752 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-2dcf108d-91b2-42b8-b094-bae63e2eceb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:51.360742 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-fd6576d7-a826-411f-ba82-1b0c02e91f25 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281569 Nov 12 02:36:51.361368 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 667/1305] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:36:51 2021] POST /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:36:51.386520 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2dcf108d-91b2-42b8-b094-bae63e2eceb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:51.394524 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2dcf108d-91b2-42b8-b094-bae63e2eceb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:51.396111 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-2dcf108d-91b2-42b8-b094-bae63e2eceb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:51.397387 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-2dcf108d-91b2-42b8-b094-bae63e2eceb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.192156 Nov 12 02:36:51.397948 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 639/1306] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:51 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:36:52.417357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-404d9a14-2660-4107-ba21-9807823d88df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:52.418005 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-404d9a14-2660-4107-ba21-9807823d88df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:52.424324 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-404d9a14-2660-4107-ba21-9807823d88df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:52.424831 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-404d9a14-2660-4107-ba21-9807823d88df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:52.425567 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-404d9a14-2660-4107-ba21-9807823d88df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:52.426001 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-404d9a14-2660-4107-ba21-9807823d88df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:52.563138 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-404d9a14-2660-4107-ba21-9807823d88df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:52.572193 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-404d9a14-2660-4107-ba21-9807823d88df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:52.573722 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-404d9a14-2660-4107-ba21-9807823d88df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:52.574922 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-404d9a14-2660-4107-ba21-9807823d88df tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.162225 Nov 12 02:36:52.575490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 668/1307] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:52 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:52.678583 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-65a159c7-532f-462e-9baf-33cd699b40c9 req-bebf3bf1-d0ff-4d92-8898-83be44fb6c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75cfef8-bb7c-41d9-b969-d4f2454a64fd", "name": "network-vif-plugged", "status": "completed", "tag": "054e67ae-3cc3-4cc3-b945-349581ab03eb"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:36:52.680116 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:36:52.680116 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:36:52.688365 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-65a159c7-532f-462e-9baf-33cd699b40c9 req-bebf3bf1-d0ff-4d92-8898-83be44fb6c62 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:52.688887 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-65a159c7-532f-462e-9baf-33cd699b40c9 req-bebf3bf1-d0ff-4d92-8898-83be44fb6c62 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:52.701479 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-65a159c7-532f-462e-9baf-33cd699b40c9 req-bebf3bf1-d0ff-4d92-8898-83be44fb6c62 service nova] Creating event network-vif-plugged:054e67ae-3cc3-4cc3-b945-349581ab03eb for instance d75cfef8-bb7c-41d9-b969-d4f2454a64fd on hv-cinder-80857 Nov 12 02:36:52.706576 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-65a159c7-532f-462e-9baf-33cd699b40c9 req-bebf3bf1-d0ff-4d92-8898-83be44fb6c62 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032160 Nov 12 02:36:52.707412 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 640/1308] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:36:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:36:53.597279 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f82742f7-ee0e-4c79-8d1d-fb01110bf2ff tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:53.597883 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f82742f7-ee0e-4c79-8d1d-fb01110bf2ff tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:53.604454 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f82742f7-ee0e-4c79-8d1d-fb01110bf2ff tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:53.604902 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f82742f7-ee0e-4c79-8d1d-fb01110bf2ff tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:53.605684 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f82742f7-ee0e-4c79-8d1d-fb01110bf2ff tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:53.606123 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f82742f7-ee0e-4c79-8d1d-fb01110bf2ff tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:53.744768 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f82742f7-ee0e-4c79-8d1d-fb01110bf2ff tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:53.752455 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f82742f7-ee0e-4c79-8d1d-fb01110bf2ff tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:53.753951 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f82742f7-ee0e-4c79-8d1d-fb01110bf2ff tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:53.755771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f82742f7-ee0e-4c79-8d1d-fb01110bf2ff tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.162417 Nov 12 02:36:53.756329 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 669/1309] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:53 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:54.775171 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-929e338e-060d-4359-a844-677c1e2c602a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:54.775792 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-929e338e-060d-4359-a844-677c1e2c602a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:54.786488 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-929e338e-060d-4359-a844-677c1e2c602a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:54.786972 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-929e338e-060d-4359-a844-677c1e2c602a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:54.787816 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-929e338e-060d-4359-a844-677c1e2c602a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:54.788253 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-929e338e-060d-4359-a844-677c1e2c602a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:54.939035 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-929e338e-060d-4359-a844-677c1e2c602a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:54.947533 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-929e338e-060d-4359-a844-677c1e2c602a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:54.949296 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-929e338e-060d-4359-a844-677c1e2c602a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:54.950259 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-929e338e-060d-4359-a844-677c1e2c602a tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1729 microversion: 2.20 time: 0.180042 Nov 12 02:36:54.962548 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 641/1310] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:54 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:55.968362 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b324bf0e-ad6e-491e-9031-01e69b8cabf0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:55.969172 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b324bf0e-ad6e-491e-9031-01e69b8cabf0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:55.976326 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b324bf0e-ad6e-491e-9031-01e69b8cabf0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:55.976784 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b324bf0e-ad6e-491e-9031-01e69b8cabf0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:55.977570 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b324bf0e-ad6e-491e-9031-01e69b8cabf0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:55.978016 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b324bf0e-ad6e-491e-9031-01e69b8cabf0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:56.110078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b324bf0e-ad6e-491e-9031-01e69b8cabf0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:56.118823 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b324bf0e-ad6e-491e-9031-01e69b8cabf0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:56.120339 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-b324bf0e-ad6e-491e-9031-01e69b8cabf0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:36:56.121508 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b324bf0e-ad6e-491e-9031-01e69b8cabf0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1716 microversion: 2.20 time: 0.156948 Nov 12 02:36:56.122072 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 670/1311] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:36:55 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:36:58.868281 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-eae590f0-2bf5-40f8-ab2b-c0b8d3e3950b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:58.869831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-eae590f0-2bf5-40f8-ab2b-c0b8d3e3950b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:58.877398 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eae590f0-2bf5-40f8-ab2b-c0b8d3e3950b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:58.877853 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eae590f0-2bf5-40f8-ab2b-c0b8d3e3950b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:58.878652 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eae590f0-2bf5-40f8-ab2b-c0b8d3e3950b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:58.879125 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-eae590f0-2bf5-40f8-ab2b-c0b8d3e3950b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:58.913003 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-eae590f0-2bf5-40f8-ab2b-c0b8d3e3950b tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051557 Nov 12 02:36:58.913501 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 642/1312] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:36:58 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:36:59.198419 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fbafd168-7be0-44d7-9074-80b0e4ce615c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:59.199011 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-fbafd168-7be0-44d7-9074-80b0e4ce615c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:59.205847 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fbafd168-7be0-44d7-9074-80b0e4ce615c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:59.206302 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fbafd168-7be0-44d7-9074-80b0e4ce615c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:59.207142 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fbafd168-7be0-44d7-9074-80b0e4ce615c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:59.207583 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fbafd168-7be0-44d7-9074-80b0e4ce615c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:59.244166 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-fbafd168-7be0-44d7-9074-80b0e4ce615c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments/7dd05ec9-9bfd-4358-94b1-1acc0189f262" status: 200 len: 194 microversion: 2.1 time: 0.049470 Nov 12 02:36:59.244785 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 671/1313] 10.222.0.70 () {58 vars in 1412 bytes} [Fri Nov 12 02:36:59 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments/7dd05ec9-9bfd-4358-94b1-1acc0189f262 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:36:59.254690 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c45feccf-af16-42c1-87c6-0e13be1b89c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:36:59.255199 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c45feccf-af16-42c1-87c6-0e13be1b89c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:36:59.261307 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c45feccf-af16-42c1-87c6-0e13be1b89c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:59.261751 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c45feccf-af16-42c1-87c6-0e13be1b89c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:59.262533 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c45feccf-af16-42c1-87c6-0e13be1b89c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:36:59.263013 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c45feccf-af16-42c1-87c6-0e13be1b89c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:36:59.341874 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-c45feccf-af16-42c1-87c6-0e13be1b89c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lazy-loading 'services' on Instance uuid dfe1c1de-88eb-40a0-8799-5cc1dec271f5 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:36:59.425064 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c45feccf-af16-42c1-87c6-0e13be1b89c9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments/7dd05ec9-9bfd-4358-94b1-1acc0189f262" status: 202 len: 0 microversion: 2.1 time: 0.173933 Nov 12 02:36:59.425697 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 643/1314] 10.222.0.70 () {58 vars in 1415 bytes} [Fri Nov 12 02:36:59 2021] DELETE /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments/7dd05ec9-9bfd-4358-94b1-1acc0189f262 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:37:01.773138 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e80a79bc-5b3a-487b-af2b-d6cb729ba2f0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:01.773741 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e80a79bc-5b3a-487b-af2b-d6cb729ba2f0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:01.781366 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e80a79bc-5b3a-487b-af2b-d6cb729ba2f0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:01.782099 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e80a79bc-5b3a-487b-af2b-d6cb729ba2f0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:01.783426 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e80a79bc-5b3a-487b-af2b-d6cb729ba2f0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:01.784168 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e80a79bc-5b3a-487b-af2b-d6cb729ba2f0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:01.817863 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e80a79bc-5b3a-487b-af2b-d6cb729ba2f0 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments/25dff7cd-6b5e-4005-83f0-8c0ae4444a7a" status: 200 len: 194 microversion: 2.1 time: 0.049012 Nov 12 02:37:01.818578 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 672/1315] 10.222.0.70 () {58 vars in 1412 bytes} [Fri Nov 12 02:37:01 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments/25dff7cd-6b5e-4005-83f0-8c0ae4444a7a => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:37:01.829509 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-166f8140-fe34-4b8f-af63-143bdaecff5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:01.830248 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-166f8140-fe34-4b8f-af63-143bdaecff5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:01.837685 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-166f8140-fe34-4b8f-af63-143bdaecff5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:01.838127 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-166f8140-fe34-4b8f-af63-143bdaecff5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:01.838957 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-166f8140-fe34-4b8f-af63-143bdaecff5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:01.839391 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-166f8140-fe34-4b8f-af63-143bdaecff5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:01.917615 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-166f8140-fe34-4b8f-af63-143bdaecff5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lazy-loading 'services' on Instance uuid dfe1c1de-88eb-40a0-8799-5cc1dec271f5 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:37:02.000356 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-166f8140-fe34-4b8f-af63-143bdaecff5f tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments/25dff7cd-6b5e-4005-83f0-8c0ae4444a7a" status: 202 len: 0 microversion: 2.1 time: 0.175509 Nov 12 02:37:02.000939 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 644/1316] 10.222.0.70 () {58 vars in 1415 bytes} [Fri Nov 12 02:37:01 2021] DELETE /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments/25dff7cd-6b5e-4005-83f0-8c0ae4444a7a => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:37:03.165552 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ffec5e2a-8cc4-405c-99f4-1e782e47d897 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:03.166514 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ffec5e2a-8cc4-405c-99f4-1e782e47d897 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:03.172915 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ffec5e2a-8cc4-405c-99f4-1e782e47d897 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:03.173294 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ffec5e2a-8cc4-405c-99f4-1e782e47d897 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:03.174068 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ffec5e2a-8cc4-405c-99f4-1e782e47d897 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:03.174495 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ffec5e2a-8cc4-405c-99f4-1e782e47d897 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:03.204673 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ffec5e2a-8cc4-405c-99f4-1e782e47d897 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042851 Nov 12 02:37:03.205235 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 673/1317] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:37:03 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:37:03.312152 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d7f16b63-2f96-45f0-9e6b-367aa73c2946 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:03.313348 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d7f16b63-2f96-45f0-9e6b-367aa73c2946 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:03.320276 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7f16b63-2f96-45f0-9e6b-367aa73c2946 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:03.320796 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7f16b63-2f96-45f0-9e6b-367aa73c2946 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:03.321587 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7f16b63-2f96-45f0-9e6b-367aa73c2946 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:03.322032 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d7f16b63-2f96-45f0-9e6b-367aa73c2946 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:03.356229 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d7f16b63-2f96-45f0-9e6b-367aa73c2946 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049044 Nov 12 02:37:03.356801 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 645/1318] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:37:03 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:37:03.413039 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0cb94786-137f-41a0-83b5-3611264e8511 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:03.413540 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0cb94786-137f-41a0-83b5-3611264e8511 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:03.419486 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0cb94786-137f-41a0-83b5-3611264e8511 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:03.419939 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0cb94786-137f-41a0-83b5-3611264e8511 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:03.420723 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0cb94786-137f-41a0-83b5-3611264e8511 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:03.421165 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0cb94786-137f-41a0-83b5-3611264e8511 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:03.447264 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0cb94786-137f-41a0-83b5-3611264e8511 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Going to try to terminate instance {{(pid=116099) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:37:03.524503 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0cb94786-137f-41a0-83b5-3611264e8511 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 204 len: 0 microversion: 2.1 time: 0.115522 Nov 12 02:37:03.525132 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 674/1319] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:37:03 2021] DELETE /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:37:03.533395 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-61bdb1d6-3691-49f5-911b-16b631c6c33a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:03.534112 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-61bdb1d6-3691-49f5-911b-16b631c6c33a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:03.540697 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61bdb1d6-3691-49f5-911b-16b631c6c33a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:03.541228 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61bdb1d6-3691-49f5-911b-16b631c6c33a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:03.542063 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61bdb1d6-3691-49f5-911b-16b631c6c33a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:03.542602 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61bdb1d6-3691-49f5-911b-16b631c6c33a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:03.682695 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-61bdb1d6-3691-49f5-911b-16b631c6c33a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:37:03.690087 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-61bdb1d6-3691-49f5-911b-16b631c6c33a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1674 microversion: 2.1 time: 0.160441 Nov 12 02:37:03.690659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 646/1320] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:37:03 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:37:04.709814 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-99d6972e-100b-4c8e-9602-b8acf9a0c640 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:04.710536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-99d6972e-100b-4c8e-9602-b8acf9a0c640 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:04.716880 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-99d6972e-100b-4c8e-9602-b8acf9a0c640 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:04.717328 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-99d6972e-100b-4c8e-9602-b8acf9a0c640 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:04.718114 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-99d6972e-100b-4c8e-9602-b8acf9a0c640 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:04.718550 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-99d6972e-100b-4c8e-9602-b8acf9a0c640 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:04.865688 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-99d6972e-100b-4c8e-9602-b8acf9a0c640 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:37:04.874074 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-99d6972e-100b-4c8e-9602-b8acf9a0c640 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1674 microversion: 2.1 time: 0.168941 Nov 12 02:37:04.874654 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 675/1321] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:37:04 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:37:05.890729 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6d717281-5516-4aa6-8209-4004e967b87a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:05.891342 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6d717281-5516-4aa6-8209-4004e967b87a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:05.898400 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d717281-5516-4aa6-8209-4004e967b87a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:05.898887 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d717281-5516-4aa6-8209-4004e967b87a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:05.899787 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d717281-5516-4aa6-8209-4004e967b87a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:05.900234 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6d717281-5516-4aa6-8209-4004e967b87a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:06.038422 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6d717281-5516-4aa6-8209-4004e967b87a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:37:06.045774 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6d717281-5516-4aa6-8209-4004e967b87a tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1674 microversion: 2.1 time: 0.158621 Nov 12 02:37:06.046342 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 647/1322] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:37:05 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:37:07.060352 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-7308515d-9d1c-4e05-9a1d-4502ff55fbf8 req-02bd7bd9-17bc-4045-8dde-428112d93107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe1c1de-88eb-40a0-8799-5cc1dec271f5", "name": "network-vif-deleted", "tag": "5888bc48-d959-49a9-a8ab-cc91e012e935"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:37:07.061970 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:37:07.061970 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:37:07.064804 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4ff9ece4-b090-40cc-bbb3-93f92a76d4d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:07.066147 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4ff9ece4-b090-40cc-bbb3-93f92a76d4d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:07.072622 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-7308515d-9d1c-4e05-9a1d-4502ff55fbf8 req-02bd7bd9-17bc-4045-8dde-428112d93107 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:07.073517 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-7308515d-9d1c-4e05-9a1d-4502ff55fbf8 req-02bd7bd9-17bc-4045-8dde-428112d93107 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:07.074905 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ff9ece4-b090-40cc-bbb3-93f92a76d4d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:07.075673 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ff9ece4-b090-40cc-bbb3-93f92a76d4d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:07.076512 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ff9ece4-b090-40cc-bbb3-93f92a76d4d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:07.077198 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ff9ece4-b090-40cc-bbb3-93f92a76d4d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:07.088602 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-7308515d-9d1c-4e05-9a1d-4502ff55fbf8 req-02bd7bd9-17bc-4045-8dde-428112d93107 service nova] Creating event network-vif-deleted:5888bc48-d959-49a9-a8ab-cc91e012e935 for instance dfe1c1de-88eb-40a0-8799-5cc1dec271f5 on hv-cinder-80857 Nov 12 02:37:07.096713 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-7308515d-9d1c-4e05-9a1d-4502ff55fbf8 req-02bd7bd9-17bc-4045-8dde-428112d93107 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130377 Nov 12 02:37:07.097330 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 676/1323] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:37:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:37:07.135413 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ff9ece4-b090-40cc-bbb3-93f92a76d4d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:07.135924 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4ff9ece4-b090-40cc-bbb3-93f92a76d4d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:07.136394 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-4ff9ece4-b090-40cc-bbb3-93f92a76d4d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lazy-loading 'fault' on Instance uuid dfe1c1de-88eb-40a0-8799-5cc1dec271f5 {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:37:07.187573 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-4ff9ece4-b090-40cc-bbb3-93f92a76d4d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808aadbd72b54806add54c601d755481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4b228dda14fa7852c7fe639ed28b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:37:07.196003 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4ff9ece4-b090-40cc-bbb3-93f92a76d4d3 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 200 len: 1328 microversion: 2.1 time: 0.136024 Nov 12 02:37:07.197087 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 648/1324] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:37:07 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 1328 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:37:08.214224 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d5ba49ff-bb25-451f-9166-95f3461ace84 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:08.214952 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d5ba49ff-bb25-451f-9166-95f3461ace84 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:08.221821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d5ba49ff-bb25-451f-9166-95f3461ace84 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:08.222267 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d5ba49ff-bb25-451f-9166-95f3461ace84 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:08.223194 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d5ba49ff-bb25-451f-9166-95f3461ace84 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:08.223630 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d5ba49ff-bb25-451f-9166-95f3461ace84 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:08.236904 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-d5ba49ff-bb25-451f-9166-95f3461ace84 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] HTTP exception thrown: Instance dfe1c1de-88eb-40a0-8799-5cc1dec271f5 could not be found. Nov 12 02:37:08.237484 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d5ba49ff-bb25-451f-9166-95f3461ace84 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Returning 404 to user: Instance dfe1c1de-88eb-40a0-8799-5cc1dec271f5 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:37:08.238255 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d5ba49ff-bb25-451f-9166-95f3461ace84 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 404 len: 111 microversion: 2.1 time: 0.028176 Nov 12 02:37:08.238889 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 677/1325] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:37:08 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:37:08.247149 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-84d35b55-6398-406f-a286-fab456f7c35e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '.version_select at 0x7fc064682820>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:08.267234 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-84d35b55-6398-406f-a286-fab456f7c35e tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116387881" status: 202 len: 0 microversion: 2.1 time: 0.023549 Nov 12 02:37:08.267717 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 649/1326] 10.222.0.70 () {58 vars in 1220 bytes} [Fri Nov 12 02:37:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116387881 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:37:11.182523 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8848bad9-eb63-4fb2-a178-09d25b8026bb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:11.183145 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8848bad9-eb63-4fb2-a178-09d25b8026bb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:11.189446 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8848bad9-eb63-4fb2-a178-09d25b8026bb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:11.189902 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8848bad9-eb63-4fb2-a178-09d25b8026bb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:11.190712 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8848bad9-eb63-4fb2-a178-09d25b8026bb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:11.191156 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8848bad9-eb63-4fb2-a178-09d25b8026bb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:11.205483 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-8848bad9-eb63-4fb2-a178-09d25b8026bb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] HTTP exception thrown: Instance dfe1c1de-88eb-40a0-8799-5cc1dec271f5 could not be found. Nov 12 02:37:11.206109 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8848bad9-eb63-4fb2-a178-09d25b8026bb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Returning 404 to user: Instance dfe1c1de-88eb-40a0-8799-5cc1dec271f5 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:37:11.206977 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8848bad9-eb63-4fb2-a178-09d25b8026bb tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 404 len: 111 microversion: 2.1 time: 0.028169 Nov 12 02:37:11.208144 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 678/1327] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:37:11 2021] DELETE /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:37:11.217167 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7b753e43-fe85-438b-a438-5ff6f8edfd3c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:11.217782 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7b753e43-fe85-438b-a438-5ff6f8edfd3c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: dfe1c1de-88eb-40a0-8799-5cc1dec271f5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:11.224909 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7b753e43-fe85-438b-a438-5ff6f8edfd3c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:11.225360 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7b753e43-fe85-438b-a438-5ff6f8edfd3c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:11.226139 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7b753e43-fe85-438b-a438-5ff6f8edfd3c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:11.226584 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7b753e43-fe85-438b-a438-5ff6f8edfd3c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:11.239452 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-7b753e43-fe85-438b-a438-5ff6f8edfd3c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] HTTP exception thrown: Instance dfe1c1de-88eb-40a0-8799-5cc1dec271f5 could not be found. Nov 12 02:37:11.240103 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7b753e43-fe85-438b-a438-5ff6f8edfd3c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Returning 404 to user: Instance dfe1c1de-88eb-40a0-8799-5cc1dec271f5 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:37:11.240936 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7b753e43-fe85-438b-a438-5ff6f8edfd3c tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5" status: 404 len: 111 microversion: 2.1 time: 0.028028 Nov 12 02:37:11.241486 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 650/1328] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:37:11 2021] GET /compute/v2.1/servers/dfe1c1de-88eb-40a0-8799-5cc1dec271f5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:37:12.368591 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b1f49539-abac-4478-93d0-14c9b2107a80 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:12.369104 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-b1f49539-abac-4478-93d0-14c9b2107a80 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:12.375651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b1f49539-abac-4478-93d0-14c9b2107a80 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:12.376099 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b1f49539-abac-4478-93d0-14c9b2107a80 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:12.376881 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b1f49539-abac-4478-93d0-14c9b2107a80 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:12.377317 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-b1f49539-abac-4478-93d0-14c9b2107a80 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:12.390672 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-b1f49539-abac-4478-93d0-14c9b2107a80 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] HTTP exception thrown: Instance 5c1ce3bd-1739-49be-ab2e-e81c1026ae30 could not be found. Nov 12 02:37:12.391256 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-b1f49539-abac-4478-93d0-14c9b2107a80 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Returning 404 to user: Instance 5c1ce3bd-1739-49be-ab2e-e81c1026ae30 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:37:12.392083 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-b1f49539-abac-4478-93d0-14c9b2107a80 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 404 len: 111 microversion: 2.1 time: 0.027488 Nov 12 02:37:12.392626 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 679/1329] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:37:12 2021] DELETE /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:37:12.401428 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-deeb9fcb-a4fd-4855-be5c-31552f58d7e9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:12.401990 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-deeb9fcb-a4fd-4855-be5c-31552f58d7e9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] [instance: 5c1ce3bd-1739-49be-ab2e-e81c1026ae30] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:12.408174 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-deeb9fcb-a4fd-4855-be5c-31552f58d7e9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:12.408623 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-deeb9fcb-a4fd-4855-be5c-31552f58d7e9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:12.409399 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-deeb9fcb-a4fd-4855-be5c-31552f58d7e9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:12.409833 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-deeb9fcb-a4fd-4855-be5c-31552f58d7e9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:12.423554 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-deeb9fcb-a4fd-4855-be5c-31552f58d7e9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] HTTP exception thrown: Instance 5c1ce3bd-1739-49be-ab2e-e81c1026ae30 could not be found. Nov 12 02:37:12.424169 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-deeb9fcb-a4fd-4855-be5c-31552f58d7e9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] Returning 404 to user: Instance 5c1ce3bd-1739-49be-ab2e-e81c1026ae30 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:37:12.424994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-deeb9fcb-a4fd-4855-be5c-31552f58d7e9 tempest-AttachVolumeTestJSON-553879426 tempest-AttachVolumeTestJSON-553879426-project] 10.222.0.70 "GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30" status: 404 len: 111 microversion: 2.1 time: 0.027383 Nov 12 02:37:12.425564 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 651/1330] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:37:12 2021] GET /compute/v2.1/servers/5c1ce3bd-1739-49be-ab2e-e81c1026ae30 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:37:53.518558 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3bff32f5-2ba9-43eb-a2d3-f712f604967d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:53.518558 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3bff32f5-2ba9-43eb-a2d3-f712f604967d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:53.522915 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3bff32f5-2ba9-43eb-a2d3-f712f604967d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:53.523641 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3bff32f5-2ba9-43eb-a2d3-f712f604967d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:53.524432 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3bff32f5-2ba9-43eb-a2d3-f712f604967d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:53.525038 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3bff32f5-2ba9-43eb-a2d3-f712f604967d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:53.553728 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3bff32f5-2ba9-43eb-a2d3-f712f604967d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Going to try to terminate instance {{(pid=116099) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:37:53.681139 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3bff32f5-2ba9-43eb-a2d3-f712f604967d tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 204 len: 0 microversion: 2.1 time: 0.170524 Nov 12 02:37:53.684337 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 680/1331] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:37:53 2021] DELETE /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:37:53.694095 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ebcf17c5-cb79-4a35-87d2-b36de3b24ab8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:53.694837 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ebcf17c5-cb79-4a35-87d2-b36de3b24ab8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:53.702071 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ebcf17c5-cb79-4a35-87d2-b36de3b24ab8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:53.702537 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ebcf17c5-cb79-4a35-87d2-b36de3b24ab8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:53.709364 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ebcf17c5-cb79-4a35-87d2-b36de3b24ab8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:53.709824 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ebcf17c5-cb79-4a35-87d2-b36de3b24ab8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:53.808355 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-e1f130bf-875a-4498-83ad-825b03297c93 req-22a3e237-f2a1-467a-973f-cbe829973680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83a6744-71fc-40f8-b0f5-7fbf936ddaea", "tag": "485ec9f6-9b65-4fdd-93d9-7e0ef9c14d71"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:37:53.812147 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:37:53.812147 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:37:53.826009 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-e1f130bf-875a-4498-83ad-825b03297c93 req-22a3e237-f2a1-467a-973f-cbe829973680 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:53.827276 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-e1f130bf-875a-4498-83ad-825b03297c93 req-22a3e237-f2a1-467a-973f-cbe829973680 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:53.845278 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-e1f130bf-875a-4498-83ad-825b03297c93 req-22a3e237-f2a1-467a-973f-cbe829973680 service nova] Creating event network-changed:485ec9f6-9b65-4fdd-93d9-7e0ef9c14d71 for instance b83a6744-71fc-40f8-b0f5-7fbf936ddaea on hv-cinder-80857 Nov 12 02:37:53.854831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-e1f130bf-875a-4498-83ad-825b03297c93 req-22a3e237-f2a1-467a-973f-cbe829973680 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.334590 Nov 12 02:37:53.861505 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 652/1332] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:37:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:37:53.890966 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ebcf17c5-cb79-4a35-87d2-b36de3b24ab8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:37:53.902351 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ebcf17c5-cb79-4a35-87d2-b36de3b24ab8 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1577 microversion: 2.1 time: 0.212142 Nov 12 02:37:53.915678 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 681/1333] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:37:53 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:37:54.923574 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-acc4ccc3-f4dc-4bf3-9019-a3bdee056434 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:54.924363 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-acc4ccc3-f4dc-4bf3-9019-a3bdee056434 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:54.931024 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-acc4ccc3-f4dc-4bf3-9019-a3bdee056434 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:54.931700 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-acc4ccc3-f4dc-4bf3-9019-a3bdee056434 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:54.932481 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-acc4ccc3-f4dc-4bf3-9019-a3bdee056434 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:54.932911 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-acc4ccc3-f4dc-4bf3-9019-a3bdee056434 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:55.095837 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-acc4ccc3-f4dc-4bf3-9019-a3bdee056434 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:37:55.103941 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-acc4ccc3-f4dc-4bf3-9019-a3bdee056434 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1458 microversion: 2.1 time: 0.184942 Nov 12 02:37:55.104510 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 653/1334] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:37:54 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1458 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:37:56.122357 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-656e21c1-ff23-42e3-ad4c-660825f46455 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:56.122994 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-656e21c1-ff23-42e3-ad4c-660825f46455 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:56.129942 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-656e21c1-ff23-42e3-ad4c-660825f46455 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:56.130393 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-656e21c1-ff23-42e3-ad4c-660825f46455 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:56.131288 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-656e21c1-ff23-42e3-ad4c-660825f46455 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:56.131894 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-656e21c1-ff23-42e3-ad4c-660825f46455 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:56.466849 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-656e21c1-ff23-42e3-ad4c-660825f46455 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:37:56.477937 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-656e21c1-ff23-42e3-ad4c-660825f46455 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1458 microversion: 2.1 time: 0.359076 Nov 12 02:37:56.478646 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 682/1335] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:37:56 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1458 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:37:57.045831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-22f84dcd-8466-4847-a935-a95ae62cb4b6 req-0b19fc04-ef13-47f4-a3c4-7779d65b1f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83a6744-71fc-40f8-b0f5-7fbf936ddaea", "name": "network-vif-deleted", "tag": "485ec9f6-9b65-4fdd-93d9-7e0ef9c14d71"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:37:57.047385 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:37:57.047385 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:37:57.054640 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-22f84dcd-8466-4847-a935-a95ae62cb4b6 req-0b19fc04-ef13-47f4-a3c4-7779d65b1f2e service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:57.055118 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-22f84dcd-8466-4847-a935-a95ae62cb4b6 req-0b19fc04-ef13-47f4-a3c4-7779d65b1f2e service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:57.066784 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-22f84dcd-8466-4847-a935-a95ae62cb4b6 req-0b19fc04-ef13-47f4-a3c4-7779d65b1f2e service nova] Creating event network-vif-deleted:485ec9f6-9b65-4fdd-93d9-7e0ef9c14d71 for instance b83a6744-71fc-40f8-b0f5-7fbf936ddaea on hv-cinder-80857 Nov 12 02:37:57.073110 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-22f84dcd-8466-4847-a935-a95ae62cb4b6 req-0b19fc04-ef13-47f4-a3c4-7779d65b1f2e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030899 Nov 12 02:37:57.073987 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 654/1336] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:37:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:37:57.505526 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-fd37b7d4-a683-41c1-b87b-aaa41831724b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:57.506143 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-fd37b7d4-a683-41c1-b87b-aaa41831724b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:57.512675 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd37b7d4-a683-41c1-b87b-aaa41831724b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:57.513139 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd37b7d4-a683-41c1-b87b-aaa41831724b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:57.513945 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd37b7d4-a683-41c1-b87b-aaa41831724b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:57.514385 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd37b7d4-a683-41c1-b87b-aaa41831724b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:57.562482 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd37b7d4-a683-41c1-b87b-aaa41831724b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:57.562482 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-fd37b7d4-a683-41c1-b87b-aaa41831724b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:57.564943 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-fd37b7d4-a683-41c1-b87b-aaa41831724b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lazy-loading 'fault' on Instance uuid b83a6744-71fc-40f8-b0f5-7fbf936ddaea {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:37:57.618099 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-fd37b7d4-a683-41c1-b87b-aaa41831724b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:37:57.626030 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-fd37b7d4-a683-41c1-b87b-aaa41831724b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 200 len: 1231 microversion: 2.1 time: 0.124810 Nov 12 02:37:57.626785 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 683/1337] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:37:57 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 1231 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:37:58.645342 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f0b57b87-c6f1-4aa7-b04c-1f9e553fe012 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:37:58.645858 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f0b57b87-c6f1-4aa7-b04c-1f9e553fe012 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: b83a6744-71fc-40f8-b0f5-7fbf936ddaea] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:37:58.652180 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f0b57b87-c6f1-4aa7-b04c-1f9e553fe012 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:58.652632 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f0b57b87-c6f1-4aa7-b04c-1f9e553fe012 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:58.653425 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f0b57b87-c6f1-4aa7-b04c-1f9e553fe012 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:37:58.653863 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f0b57b87-c6f1-4aa7-b04c-1f9e553fe012 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:37:58.667498 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-f0b57b87-c6f1-4aa7-b04c-1f9e553fe012 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] HTTP exception thrown: Instance b83a6744-71fc-40f8-b0f5-7fbf936ddaea could not be found. Nov 12 02:37:58.668101 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f0b57b87-c6f1-4aa7-b04c-1f9e553fe012 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Returning 404 to user: Instance b83a6744-71fc-40f8-b0f5-7fbf936ddaea could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:37:58.669405 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f0b57b87-c6f1-4aa7-b04c-1f9e553fe012 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea" status: 404 len: 111 microversion: 2.1 time: 0.028551 Nov 12 02:37:58.669704 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 655/1338] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:37:58 2021] GET /compute/v2.1/servers/b83a6744-71fc-40f8-b0f5-7fbf936ddaea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:38:01.849518 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a9d115fe-9f42-4245-a12c-218720414075 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:01.850092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a9d115fe-9f42-4245-a12c-218720414075 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:01.852969 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-406e4fc4-2b1b-464c-b0de-b15193710c58 req-170cf76c-e5b9-4edf-bdfc-95db21a59025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b66789-7ae5-4589-bd84-3539cf00e97f", "tag": "9ea72f7b-3a91-4bd5-9bee-cf36f50653a8"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:38:01.855064 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:38:01.855064 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:38:01.856719 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a9d115fe-9f42-4245-a12c-218720414075 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:01.857236 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a9d115fe-9f42-4245-a12c-218720414075 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:01.858111 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a9d115fe-9f42-4245-a12c-218720414075 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:01.858616 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a9d115fe-9f42-4245-a12c-218720414075 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:01.879719 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-406e4fc4-2b1b-464c-b0de-b15193710c58 req-170cf76c-e5b9-4edf-bdfc-95db21a59025 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:01.880507 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-406e4fc4-2b1b-464c-b0de-b15193710c58 req-170cf76c-e5b9-4edf-bdfc-95db21a59025 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:01.885818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a9d115fe-9f42-4245-a12c-218720414075 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Going to try to terminate instance {{(pid=116099) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:38:01.893840 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-406e4fc4-2b1b-464c-b0de-b15193710c58 req-170cf76c-e5b9-4edf-bdfc-95db21a59025 service nova] Creating event network-changed:9ea72f7b-3a91-4bd5-9bee-cf36f50653a8 for instance 41b66789-7ae5-4589-bd84-3539cf00e97f on hv-cinder-80857 Nov 12 02:38:01.900335 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-406e4fc4-2b1b-464c-b0de-b15193710c58 req-170cf76c-e5b9-4edf-bdfc-95db21a59025 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051104 Nov 12 02:38:01.901670 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 656/1339] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:38:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:38:01.992813 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a9d115fe-9f42-4245-a12c-218720414075 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "DELETE /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 204 len: 0 microversion: 2.1 time: 0.144685 Nov 12 02:38:01.993774 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 684/1340] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:38:01 2021] DELETE /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:38:02.006283 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-20d3b36a-8843-46de-b3c4-eb8e4198be40 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:02.006283 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-20d3b36a-8843-46de-b3c4-eb8e4198be40 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:02.015263 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20d3b36a-8843-46de-b3c4-eb8e4198be40 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:02.015738 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20d3b36a-8843-46de-b3c4-eb8e4198be40 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:02.016601 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20d3b36a-8843-46de-b3c4-eb8e4198be40 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:02.017040 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20d3b36a-8843-46de-b3c4-eb8e4198be40 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:02.274231 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-20d3b36a-8843-46de-b3c4-eb8e4198be40 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:02.283751 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-20d3b36a-8843-46de-b3c4-eb8e4198be40 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1575 microversion: 2.1 time: 0.285331 Nov 12 02:38:02.285450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 657/1341] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:01 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1575 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:03.302347 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6fd3b2a8-3314-4687-97de-cb421f2081cd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:03.302998 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6fd3b2a8-3314-4687-97de-cb421f2081cd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:03.309224 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6fd3b2a8-3314-4687-97de-cb421f2081cd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:03.309669 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6fd3b2a8-3314-4687-97de-cb421f2081cd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:03.310439 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6fd3b2a8-3314-4687-97de-cb421f2081cd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:03.310907 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6fd3b2a8-3314-4687-97de-cb421f2081cd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:03.536788 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6fd3b2a8-3314-4687-97de-cb421f2081cd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cae9ebcf844041b45c03bfd1fddcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdddbe78d48c4a9995c9d3e6c06bec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:03.552095 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6fd3b2a8-3314-4687-97de-cb421f2081cd tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 200 len: 1457 microversion: 2.1 time: 0.254274 Nov 12 02:38:03.552963 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 685/1342] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:03 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 1457 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:03.682633 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-bf551a28-ff5f-4598-93ee-a626d02f9988 req-e937fa81-a672-47f5-856c-3cea69d7c670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b66789-7ae5-4589-bd84-3539cf00e97f", "name": "network-vif-deleted", "tag": "9ea72f7b-3a91-4bd5-9bee-cf36f50653a8"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:38:03.685261 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:38:03.685261 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:38:03.696555 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-bf551a28-ff5f-4598-93ee-a626d02f9988 req-e937fa81-a672-47f5-856c-3cea69d7c670 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:03.697086 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-bf551a28-ff5f-4598-93ee-a626d02f9988 req-e937fa81-a672-47f5-856c-3cea69d7c670 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:03.718846 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-bf551a28-ff5f-4598-93ee-a626d02f9988 req-e937fa81-a672-47f5-856c-3cea69d7c670 service nova] Creating event network-vif-deleted:9ea72f7b-3a91-4bd5-9bee-cf36f50653a8 for instance 41b66789-7ae5-4589-bd84-3539cf00e97f on hv-cinder-80857 Nov 12 02:38:03.728367 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-bf551a28-ff5f-4598-93ee-a626d02f9988 req-e937fa81-a672-47f5-856c-3cea69d7c670 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051080 Nov 12 02:38:03.729932 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 658/1343] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:38:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:38:04.572566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1ccb3f2c-cfc0-4ece-9528-cc9d5f608d82 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:04.573369 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1ccb3f2c-cfc0-4ece-9528-cc9d5f608d82 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: 41b66789-7ae5-4589-bd84-3539cf00e97f] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:04.584102 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1ccb3f2c-cfc0-4ece-9528-cc9d5f608d82 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:04.584575 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1ccb3f2c-cfc0-4ece-9528-cc9d5f608d82 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:04.585674 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1ccb3f2c-cfc0-4ece-9528-cc9d5f608d82 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:04.586212 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1ccb3f2c-cfc0-4ece-9528-cc9d5f608d82 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:04.604621 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-1ccb3f2c-cfc0-4ece-9528-cc9d5f608d82 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] HTTP exception thrown: Instance 41b66789-7ae5-4589-bd84-3539cf00e97f could not be found. Nov 12 02:38:04.605703 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1ccb3f2c-cfc0-4ece-9528-cc9d5f608d82 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Returning 404 to user: Instance 41b66789-7ae5-4589-bd84-3539cf00e97f could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:38:04.607234 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1ccb3f2c-cfc0-4ece-9528-cc9d5f608d82 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f" status: 404 len: 111 microversion: 2.1 time: 0.040542 Nov 12 02:38:04.608290 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 686/1344] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:04 2021] GET /compute/v2.1/servers/41b66789-7ae5-4589-bd84-3539cf00e97f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:38:05.077264 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3c56b9c6-2261-4520-a080-20dec2332c2b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:05.077855 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3c56b9c6-2261-4520-a080-20dec2332c2b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:05.084372 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3c56b9c6-2261-4520-a080-20dec2332c2b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:05.084817 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3c56b9c6-2261-4520-a080-20dec2332c2b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:05.085595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3c56b9c6-2261-4520-a080-20dec2332c2b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:05.086030 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3c56b9c6-2261-4520-a080-20dec2332c2b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:05.099272 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-3c56b9c6-2261-4520-a080-20dec2332c2b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] HTTP exception thrown: Instance a5f436b1-6651-4ba7-88f7-fb2b262f75a5 could not be found. Nov 12 02:38:05.099791 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3c56b9c6-2261-4520-a080-20dec2332c2b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Returning 404 to user: Instance a5f436b1-6651-4ba7-88f7-fb2b262f75a5 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:38:05.100611 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3c56b9c6-2261-4520-a080-20dec2332c2b tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 404 len: 111 microversion: 2.1 time: 0.027434 Nov 12 02:38:05.101141 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 659/1345] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:38:05 2021] DELETE /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:38:05.108976 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0fb8462c-5b25-4d43-9e77-ad28356b7382 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:05.109579 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0fb8462c-5b25-4d43-9e77-ad28356b7382 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] [instance: a5f436b1-6651-4ba7-88f7-fb2b262f75a5] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:05.115937 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0fb8462c-5b25-4d43-9e77-ad28356b7382 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:05.116387 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0fb8462c-5b25-4d43-9e77-ad28356b7382 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:05.117148 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0fb8462c-5b25-4d43-9e77-ad28356b7382 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:05.117840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0fb8462c-5b25-4d43-9e77-ad28356b7382 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:05.130551 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-0fb8462c-5b25-4d43-9e77-ad28356b7382 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] HTTP exception thrown: Instance a5f436b1-6651-4ba7-88f7-fb2b262f75a5 could not be found. Nov 12 02:38:05.131160 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0fb8462c-5b25-4d43-9e77-ad28356b7382 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Returning 404 to user: Instance a5f436b1-6651-4ba7-88f7-fb2b262f75a5 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:38:05.131967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0fb8462c-5b25-4d43-9e77-ad28356b7382 tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5" status: 404 len: 111 microversion: 2.1 time: 0.026701 Nov 12 02:38:05.132488 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 687/1346] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:05 2021] GET /compute/v2.1/servers/a5f436b1-6651-4ba7-88f7-fb2b262f75a5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:38:06.412145 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ddd63fe0-d57b-47be-8750-1c5f15d7a6ab tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] Calling method '.version_select at 0x7fc064758b80>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:06.433799 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ddd63fe0-d57b-47be-8750-1c5f15d7a6ab tempest-TestVolumeBootPattern-2117708258 tempest-TestVolumeBootPattern-2117708258-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1761431138" status: 202 len: 0 microversion: 2.1 time: 0.026756 Nov 12 02:38:06.434858 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 660/1347] 10.222.0.70 () {58 vars in 1262 bytes} [Fri Nov 12 02:38:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1761431138 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:38:12.483193 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-9608e217-cf7b-4c06-99b2-96ddf5b09244 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:12.484122 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-9608e217-cf7b-4c06-99b2-96ddf5b09244 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:12.494864 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9608e217-cf7b-4c06-99b2-96ddf5b09244 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:12.495426 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9608e217-cf7b-4c06-99b2-96ddf5b09244 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:12.497091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9608e217-cf7b-4c06-99b2-96ddf5b09244 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:12.497688 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-9608e217-cf7b-4c06-99b2-96ddf5b09244 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:12.549757 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-9608e217-cf7b-4c06-99b2-96ddf5b09244 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.071745 Nov 12 02:38:12.551181 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 688/1348] 10.222.0.70 () {60 vars in 1342 bytes} [Fri Nov 12 02:38:12 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:12.630435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-84e77afd-3233-436d-ba3e-762c982880ce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:12.632221 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-84e77afd-3233-436d-ba3e-762c982880ce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:12.644325 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84e77afd-3233-436d-ba3e-762c982880ce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:12.645768 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84e77afd-3233-436d-ba3e-762c982880ce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:12.648858 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84e77afd-3233-436d-ba3e-762c982880ce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:12.649644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-84e77afd-3233-436d-ba3e-762c982880ce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:12.691034 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-84e77afd-3233-436d-ba3e-762c982880ce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:38:12.800215 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-84e77afd-3233-436d-ba3e-762c982880ce tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 204 len: 0 microversion: 2.20 time: 0.178038 Nov 12 02:38:12.801169 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 661/1349] 10.222.0.70 () {60 vars in 1279 bytes} [Fri Nov 12 02:38:12 2021] DELETE /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 12 02:38:12.810109 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3ee9914e-03cb-4ad4-ba8e-df6b4a83accc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:12.810738 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3ee9914e-03cb-4ad4-ba8e-df6b4a83accc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:12.818864 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ee9914e-03cb-4ad4-ba8e-df6b4a83accc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:12.820359 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ee9914e-03cb-4ad4-ba8e-df6b4a83accc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:12.821418 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ee9914e-03cb-4ad4-ba8e-df6b4a83accc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:12.822247 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3ee9914e-03cb-4ad4-ba8e-df6b4a83accc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:13.001065 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3ee9914e-03cb-4ad4-ba8e-df6b4a83accc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:13.014458 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3ee9914e-03cb-4ad4-ba8e-df6b4a83accc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:13.016612 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3ee9914e-03cb-4ad4-ba8e-df6b4a83accc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:13.018410 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3ee9914e-03cb-4ad4-ba8e-df6b4a83accc tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.212407 Nov 12 02:38:13.019743 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 689/1350] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:38:12 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:38:14.039939 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-be35cefe-d052-4cdd-acd4-c5ea575ea641 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:14.040812 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-be35cefe-d052-4cdd-acd4-c5ea575ea641 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:14.047553 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be35cefe-d052-4cdd-acd4-c5ea575ea641 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:14.048075 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be35cefe-d052-4cdd-acd4-c5ea575ea641 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:14.048956 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be35cefe-d052-4cdd-acd4-c5ea575ea641 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:14.050049 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-be35cefe-d052-4cdd-acd4-c5ea575ea641 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:14.244515 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be35cefe-d052-4cdd-acd4-c5ea575ea641 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:14.255763 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be35cefe-d052-4cdd-acd4-c5ea575ea641 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:14.267132 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-be35cefe-d052-4cdd-acd4-c5ea575ea641 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:14.268895 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-be35cefe-d052-4cdd-acd4-c5ea575ea641 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.234222 Nov 12 02:38:14.269459 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 662/1351] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:38:14 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:38:14.454116 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1343188305", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "networks": [{"uuid": "334756d6-95c6-4257-b031-d266457d32e5"}]}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:38:14.526415 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.network.neutron [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] validate_networks() for [('334756d6-95c6-4257-b031-d266457d32e5', None, None, None, None, None)] {{(pid=116099) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:38:15.287604 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6f35339e-34bd-4c0b-885c-e86e77dc4283 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:15.288211 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6f35339e-34bd-4c0b-885c-e86e77dc4283 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:15.294564 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f35339e-34bd-4c0b-885c-e86e77dc4283 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:15.295046 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f35339e-34bd-4c0b-885c-e86e77dc4283 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:15.295839 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f35339e-34bd-4c0b-885c-e86e77dc4283 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:15.296273 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f35339e-34bd-4c0b-885c-e86e77dc4283 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:15.313441 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Flavor limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:38:15.314172 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Image limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:38:15.315205 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Flavor pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:38:15.316916 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Image pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:38:15.317762 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:38:15.327962 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:15.328745 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:15.329770 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:15.330531 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:15.351773 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Getting quotas for project 7982c0adc65a456e8d0410ad0672d97c. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:38:15.356421 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Getting quotas for user 2c20d82e63ab49daa5329f662888e9ca and project 7982c0adc65a456e8d0410ad0672d97c. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:38:15.381715 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Going to run 1 instances... {{(pid=116099) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:38:15.384941 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:38:15.435832 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5fc2fa71-ea92-4f96-b836-f6f8b535f188 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985183 Nov 12 02:38:15.436880 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 690/1352] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:38:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:38:15.450834 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-09efee43-f0b1-4407-a940-b8bcb45761d1 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:15.451992 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-09efee43-f0b1-4407-a940-b8bcb45761d1 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:15.578792 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-09efee43-f0b1-4407-a940-b8bcb45761d1 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:15.588627 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-09efee43-f0b1-4407-a940-b8bcb45761d1 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1214 microversion: 2.1 time: 0.145591 Nov 12 02:38:15.591439 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 691/1353] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:15 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:15.622802 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6f35339e-34bd-4c0b-885c-e86e77dc4283 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:15.631314 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6f35339e-34bd-4c0b-885c-e86e77dc4283 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:15.632920 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6f35339e-34bd-4c0b-885c-e86e77dc4283 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:15.634106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6f35339e-34bd-4c0b-885c-e86e77dc4283 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1722 microversion: 2.20 time: 0.350778 Nov 12 02:38:15.634659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 663/1354] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:38:15 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1722 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 12 02:38:16.101687 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-efb1eb28-d1da-4520-b554-54c92225b44d req-512e44b6-ef8f-45ec-825c-cd48a3aa9ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75cfef8-bb7c-41d9-b969-d4f2454a64fd", "name": "network-vif-deleted", "tag": "054e67ae-3cc3-4cc3-b945-349581ab03eb"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:38:16.104424 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:38:16.104424 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:38:16.112588 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-efb1eb28-d1da-4520-b554-54c92225b44d req-512e44b6-ef8f-45ec-825c-cd48a3aa9ba2 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:16.113420 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-efb1eb28-d1da-4520-b554-54c92225b44d req-512e44b6-ef8f-45ec-825c-cd48a3aa9ba2 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:16.131661 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-efb1eb28-d1da-4520-b554-54c92225b44d req-512e44b6-ef8f-45ec-825c-cd48a3aa9ba2 service nova] Creating event network-vif-deleted:054e67ae-3cc3-4cc3-b945-349581ab03eb for instance d75cfef8-bb7c-41d9-b969-d4f2454a64fd on hv-cinder-80857 Nov 12 02:38:16.138020 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-efb1eb28-d1da-4520-b554-54c92225b44d req-512e44b6-ef8f-45ec-825c-cd48a3aa9ba2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042527 Nov 12 02:38:16.139507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 692/1355] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:38:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:38:16.614436 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-437de18f-6678-4e35-a0b4-d33c73933baf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:16.617839 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-437de18f-6678-4e35-a0b4-d33c73933baf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:16.625067 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-437de18f-6678-4e35-a0b4-d33c73933baf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:16.626075 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-437de18f-6678-4e35-a0b4-d33c73933baf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:16.628045 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-437de18f-6678-4e35-a0b4-d33c73933baf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:16.628722 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-437de18f-6678-4e35-a0b4-d33c73933baf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:16.656424 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-17fe7100-5e1a-4b06-93b9-ccbc81638bb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:16.658853 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-17fe7100-5e1a-4b06-93b9-ccbc81638bb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:16.682453 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-17fe7100-5e1a-4b06-93b9-ccbc81638bb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:16.682938 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-17fe7100-5e1a-4b06-93b9-ccbc81638bb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:16.693888 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-17fe7100-5e1a-4b06-93b9-ccbc81638bb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:16.695138 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-17fe7100-5e1a-4b06-93b9-ccbc81638bb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:16.743602 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-17fe7100-5e1a-4b06-93b9-ccbc81638bb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:16.744487 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-17fe7100-5e1a-4b06-93b9-ccbc81638bb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:16.745070 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-17fe7100-5e1a-4b06-93b9-ccbc81638bb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lazy-loading 'fault' on Instance uuid d75cfef8-bb7c-41d9-b969-d4f2454a64fd {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:38:16.763681 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-437de18f-6678-4e35-a0b4-d33c73933baf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:16.772017 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-437de18f-6678-4e35-a0b4-d33c73933baf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1274 microversion: 2.1 time: 0.167314 Nov 12 02:38:16.772760 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 664/1356] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:16 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1274 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:16.822788 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-17fe7100-5e1a-4b06-93b9-ccbc81638bb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:16.831028 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-17fe7100-5e1a-4b06-93b9-ccbc81638bb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:16.832708 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-17fe7100-5e1a-4b06-93b9-ccbc81638bb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eec0f3e481084226af3e4cb004585024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e70a88f4b094066abaf2d0cd853f751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:16.834000 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-17fe7100-5e1a-4b06-93b9-ccbc81638bb6 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 200 len: 1371 microversion: 2.20 time: 0.184506 Nov 12 02:38:16.834694 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 693/1357] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:38:16 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 12 02:38:17.790111 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ce373493-a1a6-418e-af9d-30ec45bc3a5f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:17.790741 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ce373493-a1a6-418e-af9d-30ec45bc3a5f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:17.797198 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce373493-a1a6-418e-af9d-30ec45bc3a5f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:17.797639 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce373493-a1a6-418e-af9d-30ec45bc3a5f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:17.798540 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce373493-a1a6-418e-af9d-30ec45bc3a5f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:17.798994 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ce373493-a1a6-418e-af9d-30ec45bc3a5f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:17.852360 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-37c3a02a-3fc9-4f2c-bb60-66268529bf82 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:17.852989 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-37c3a02a-3fc9-4f2c-bb60-66268529bf82 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:17.860692 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-37c3a02a-3fc9-4f2c-bb60-66268529bf82 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:17.861125 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-37c3a02a-3fc9-4f2c-bb60-66268529bf82 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:17.862514 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-37c3a02a-3fc9-4f2c-bb60-66268529bf82 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:17.862979 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-37c3a02a-3fc9-4f2c-bb60-66268529bf82 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:17.879704 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-37c3a02a-3fc9-4f2c-bb60-66268529bf82 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] HTTP exception thrown: Instance d75cfef8-bb7c-41d9-b969-d4f2454a64fd could not be found. Nov 12 02:38:17.880361 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-37c3a02a-3fc9-4f2c-bb60-66268529bf82 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Returning 404 to user: Instance d75cfef8-bb7c-41d9-b969-d4f2454a64fd could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:38:17.881438 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-37c3a02a-3fc9-4f2c-bb60-66268529bf82 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 404 len: 111 microversion: 2.20 time: 0.032921 Nov 12 02:38:17.885489 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 694/1358] 10.222.0.70 () {60 vars in 1276 bytes} [Fri Nov 12 02:38:17 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 12 02:38:17.891531 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8476dd0c-4a70-4356-b3ca-f3b4f8742a4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '.version_select at 0x7fc0646303a0>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:17.912968 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8476dd0c-4a70-4356-b3ca-f3b4f8742a4f tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093012928" status: 204 len: 0 microversion: 2.20 time: 0.025899 Nov 12 02:38:17.913787 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 695/1359] 10.222.0.70 () {60 vars in 1261 bytes} [Fri Nov 12 02:38:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093012928 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 12 02:38:18.024930 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ce373493-a1a6-418e-af9d-30ec45bc3a5f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:18.033819 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ce373493-a1a6-418e-af9d-30ec45bc3a5f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1314 microversion: 2.1 time: 0.247725 Nov 12 02:38:18.034685 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 665/1360] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:17 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:18.156947 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-ce3d8e60-0f77-423d-a18c-0e227903849b req-29afd55a-622b-478b-aed4-84c31028b0aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "975adec8-53a7-4e5b-a4fe-fe79351bf240", "tag": "ec2fd124-4015-4517-8640-86fcfce38477"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:38:18.156947 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:38:18.156947 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:38:18.163429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-ce3d8e60-0f77-423d-a18c-0e227903849b req-29afd55a-622b-478b-aed4-84c31028b0aa service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:18.163871 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-ce3d8e60-0f77-423d-a18c-0e227903849b req-29afd55a-622b-478b-aed4-84c31028b0aa service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:18.175961 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-ce3d8e60-0f77-423d-a18c-0e227903849b req-29afd55a-622b-478b-aed4-84c31028b0aa service nova] Creating event network-changed:ec2fd124-4015-4517-8640-86fcfce38477 for instance 975adec8-53a7-4e5b-a4fe-fe79351bf240 on hv-cinder-80857 Nov 12 02:38:18.185262 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-ce3d8e60-0f77-423d-a18c-0e227903849b req-29afd55a-622b-478b-aed4-84c31028b0aa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034004 Nov 12 02:38:18.186190 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 696/1361] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:38:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:38:19.050437 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9c3e54ff-f7c3-4e01-9001-e4942df8812b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:19.051312 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9c3e54ff-f7c3-4e01-9001-e4942df8812b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:19.057791 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c3e54ff-f7c3-4e01-9001-e4942df8812b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:19.058244 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c3e54ff-f7c3-4e01-9001-e4942df8812b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:19.059068 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c3e54ff-f7c3-4e01-9001-e4942df8812b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:19.059509 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9c3e54ff-f7c3-4e01-9001-e4942df8812b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:19.242797 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9c3e54ff-f7c3-4e01-9001-e4942df8812b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:19.252770 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9c3e54ff-f7c3-4e01-9001-e4942df8812b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1314 microversion: 2.1 time: 0.205450 Nov 12 02:38:19.253360 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 666/1362] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:19 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:20.032355 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6d5988ca-1eaf-4e74-b2ef-d4ade55c8cae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:20.032933 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6d5988ca-1eaf-4e74-b2ef-d4ade55c8cae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:20.040083 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6d5988ca-1eaf-4e74-b2ef-d4ade55c8cae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:20.040522 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6d5988ca-1eaf-4e74-b2ef-d4ade55c8cae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:20.041294 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6d5988ca-1eaf-4e74-b2ef-d4ade55c8cae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:20.041727 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6d5988ca-1eaf-4e74-b2ef-d4ade55c8cae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:20.055507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-6d5988ca-1eaf-4e74-b2ef-d4ade55c8cae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] HTTP exception thrown: Instance d75cfef8-bb7c-41d9-b969-d4f2454a64fd could not be found. Nov 12 02:38:20.056099 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6d5988ca-1eaf-4e74-b2ef-d4ade55c8cae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Returning 404 to user: Instance d75cfef8-bb7c-41d9-b969-d4f2454a64fd could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:38:20.056932 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6d5988ca-1eaf-4e74-b2ef-d4ade55c8cae tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 404 len: 111 microversion: 2.1 time: 0.029001 Nov 12 02:38:20.057480 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 697/1363] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:38:20 2021] DELETE /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:38:20.065639 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-709801c9-1118-437c-9a4c-8361d6297543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:20.066251 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-709801c9-1118-437c-9a4c-8361d6297543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: d75cfef8-bb7c-41d9-b969-d4f2454a64fd] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:20.072700 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-709801c9-1118-437c-9a4c-8361d6297543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:20.073145 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-709801c9-1118-437c-9a4c-8361d6297543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:20.073931 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-709801c9-1118-437c-9a4c-8361d6297543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:20.074364 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-709801c9-1118-437c-9a4c-8361d6297543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:20.088489 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-709801c9-1118-437c-9a4c-8361d6297543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] HTTP exception thrown: Instance d75cfef8-bb7c-41d9-b969-d4f2454a64fd could not be found. Nov 12 02:38:20.089088 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-709801c9-1118-437c-9a4c-8361d6297543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Returning 404 to user: Instance d75cfef8-bb7c-41d9-b969-d4f2454a64fd could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:38:20.089925 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-709801c9-1118-437c-9a4c-8361d6297543 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd" status: 404 len: 111 microversion: 2.1 time: 0.028003 Nov 12 02:38:20.090485 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 667/1364] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:20 2021] GET /compute/v2.1/servers/d75cfef8-bb7c-41d9-b969-d4f2454a64fd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:38:20.269958 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-7c48dd27-9ad8-4560-9618-9f69cfc87dc0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:20.270570 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-7c48dd27-9ad8-4560-9618-9f69cfc87dc0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:20.276849 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7c48dd27-9ad8-4560-9618-9f69cfc87dc0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:20.277298 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7c48dd27-9ad8-4560-9618-9f69cfc87dc0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:20.278075 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7c48dd27-9ad8-4560-9618-9f69cfc87dc0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:20.278514 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-7c48dd27-9ad8-4560-9618-9f69cfc87dc0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:20.410600 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-7c48dd27-9ad8-4560-9618-9f69cfc87dc0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:20.417727 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-7c48dd27-9ad8-4560-9618-9f69cfc87dc0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1314 microversion: 2.1 time: 0.152099 Nov 12 02:38:20.418281 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 698/1365] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:20 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:21.216438 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-47c1d15c-7418-43b2-8f1e-5fad83a376b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:21.216931 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-47c1d15c-7418-43b2-8f1e-5fad83a376b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:21.223937 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-47c1d15c-7418-43b2-8f1e-5fad83a376b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:21.224391 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-47c1d15c-7418-43b2-8f1e-5fad83a376b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:21.225170 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-47c1d15c-7418-43b2-8f1e-5fad83a376b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:21.225608 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-47c1d15c-7418-43b2-8f1e-5fad83a376b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:21.241309 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-47c1d15c-7418-43b2-8f1e-5fad83a376b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] HTTP exception thrown: Instance 26d16c68-a04c-4a32-a599-e202e6c64152 could not be found. Nov 12 02:38:21.241898 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-47c1d15c-7418-43b2-8f1e-5fad83a376b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Returning 404 to user: Instance 26d16c68-a04c-4a32-a599-e202e6c64152 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:38:21.243026 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-47c1d15c-7418-43b2-8f1e-5fad83a376b0 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "DELETE /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 404 len: 111 microversion: 2.1 time: 0.030231 Nov 12 02:38:21.243580 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 668/1366] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:38:21 2021] DELETE /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:38:21.251431 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-be45366e-2fdd-418a-985f-0880dfb51255 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:21.252077 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-be45366e-2fdd-418a-985f-0880dfb51255 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] [instance: 26d16c68-a04c-4a32-a599-e202e6c64152] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:21.258524 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-be45366e-2fdd-418a-985f-0880dfb51255 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:21.259003 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-be45366e-2fdd-418a-985f-0880dfb51255 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:21.259776 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-be45366e-2fdd-418a-985f-0880dfb51255 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:21.260207 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-be45366e-2fdd-418a-985f-0880dfb51255 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:21.273972 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-be45366e-2fdd-418a-985f-0880dfb51255 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] HTTP exception thrown: Instance 26d16c68-a04c-4a32-a599-e202e6c64152 could not be found. Nov 12 02:38:21.274994 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-be45366e-2fdd-418a-985f-0880dfb51255 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] Returning 404 to user: Instance 26d16c68-a04c-4a32-a599-e202e6c64152 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:38:21.276354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-be45366e-2fdd-418a-985f-0880dfb51255 tempest-AttachVolumeShelveTestJSON-1020489409 tempest-AttachVolumeShelveTestJSON-1020489409-project] 10.222.0.70 "GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152" status: 404 len: 111 microversion: 2.1 time: 0.028305 Nov 12 02:38:21.277314 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 699/1367] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:21 2021] GET /compute/v2.1/servers/26d16c68-a04c-4a32-a599-e202e6c64152 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:38:21.436442 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-9a07369e-f229-4602-bb4d-9bb56a0f3adf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:21.436966 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-9a07369e-f229-4602-bb4d-9bb56a0f3adf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:21.442898 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9a07369e-f229-4602-bb4d-9bb56a0f3adf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:21.443314 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9a07369e-f229-4602-bb4d-9bb56a0f3adf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:21.444100 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9a07369e-f229-4602-bb4d-9bb56a0f3adf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:21.444538 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-9a07369e-f229-4602-bb4d-9bb56a0f3adf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:21.986580 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-9a07369e-f229-4602-bb4d-9bb56a0f3adf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:21.994984 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-9a07369e-f229-4602-bb4d-9bb56a0f3adf tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1314 microversion: 2.1 time: 0.562309 Nov 12 02:38:21.995558 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 669/1368] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:21 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:23.013274 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1af7fb4a-f477-4879-ab25-1f7794b270f3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:23.015720 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1af7fb4a-f477-4879-ab25-1f7794b270f3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:23.023871 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1af7fb4a-f477-4879-ab25-1f7794b270f3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:23.024423 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1af7fb4a-f477-4879-ab25-1f7794b270f3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:23.025303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1af7fb4a-f477-4879-ab25-1f7794b270f3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:23.025817 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1af7fb4a-f477-4879-ab25-1f7794b270f3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:23.275535 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1af7fb4a-f477-4879-ab25-1f7794b270f3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:23.282877 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1af7fb4a-f477-4879-ab25-1f7794b270f3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1314 microversion: 2.1 time: 0.273304 Nov 12 02:38:23.284108 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 700/1369] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:23 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:24.300780 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ba490a41-eeac-4c3b-8d5d-d2a1080d5605 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:24.301509 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ba490a41-eeac-4c3b-8d5d-d2a1080d5605 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:24.308670 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ba490a41-eeac-4c3b-8d5d-d2a1080d5605 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:24.309295 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ba490a41-eeac-4c3b-8d5d-d2a1080d5605 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:24.310304 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ba490a41-eeac-4c3b-8d5d-d2a1080d5605 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:24.310932 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ba490a41-eeac-4c3b-8d5d-d2a1080d5605 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:24.541851 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ba490a41-eeac-4c3b-8d5d-d2a1080d5605 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:24.550211 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ba490a41-eeac-4c3b-8d5d-d2a1080d5605 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1314 microversion: 2.1 time: 0.253685 Nov 12 02:38:24.551001 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 670/1370] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:24 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:25.224561 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-1243135a-6ff4-451b-9a06-1ec8a1ec479f req-d460afc0-6e8c-4d40-baab-f65005c1d5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975adec8-53a7-4e5b-a4fe-fe79351bf240", "name": "network-vif-plugged", "status": "completed", "tag": "ec2fd124-4015-4517-8640-86fcfce38477"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:38:25.226729 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:38:25.226729 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:38:25.236135 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-1243135a-6ff4-451b-9a06-1ec8a1ec479f req-d460afc0-6e8c-4d40-baab-f65005c1d5b5 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:25.236681 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-1243135a-6ff4-451b-9a06-1ec8a1ec479f req-d460afc0-6e8c-4d40-baab-f65005c1d5b5 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:25.248596 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-1243135a-6ff4-451b-9a06-1ec8a1ec479f req-d460afc0-6e8c-4d40-baab-f65005c1d5b5 service nova] Creating event network-vif-plugged:ec2fd124-4015-4517-8640-86fcfce38477 for instance 975adec8-53a7-4e5b-a4fe-fe79351bf240 on hv-cinder-80857 Nov 12 02:38:25.254918 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-1243135a-6ff4-451b-9a06-1ec8a1ec479f req-d460afc0-6e8c-4d40-baab-f65005c1d5b5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034595 Nov 12 02:38:25.255770 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 701/1371] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:38:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:38:25.567909 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-934d4f9c-8669-4e70-a187-b42813587805 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:25.568526 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-934d4f9c-8669-4e70-a187-b42813587805 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:25.574833 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-934d4f9c-8669-4e70-a187-b42813587805 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:25.575279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-934d4f9c-8669-4e70-a187-b42813587805 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:25.576075 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-934d4f9c-8669-4e70-a187-b42813587805 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:25.576507 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-934d4f9c-8669-4e70-a187-b42813587805 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:25.713836 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-934d4f9c-8669-4e70-a187-b42813587805 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:25.721546 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-934d4f9c-8669-4e70-a187-b42813587805 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1314 microversion: 2.1 time: 0.157712 Nov 12 02:38:25.722113 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 671/1372] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:25 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:26.739315 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8d8a6c59-208a-4c90-b418-c1402b2f8e0d tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:26.740092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8d8a6c59-208a-4c90-b418-c1402b2f8e0d tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:26.746337 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d8a6c59-208a-4c90-b418-c1402b2f8e0d tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:26.746828 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d8a6c59-208a-4c90-b418-c1402b2f8e0d tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:26.747623 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d8a6c59-208a-4c90-b418-c1402b2f8e0d tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:26.748060 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d8a6c59-208a-4c90-b418-c1402b2f8e0d tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:26.894540 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8d8a6c59-208a-4c90-b418-c1402b2f8e0d tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:26.902129 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8d8a6c59-208a-4c90-b418-c1402b2f8e0d tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1314 microversion: 2.1 time: 0.167289 Nov 12 02:38:26.902773 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 702/1373] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:26 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:27.925450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-61a3ab81-3bdd-4c0f-8830-ac38ade70a78 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:27.926206 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-61a3ab81-3bdd-4c0f-8830-ac38ade70a78 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:27.933327 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61a3ab81-3bdd-4c0f-8830-ac38ade70a78 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:27.933773 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61a3ab81-3bdd-4c0f-8830-ac38ade70a78 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:27.934565 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61a3ab81-3bdd-4c0f-8830-ac38ade70a78 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:27.935210 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-61a3ab81-3bdd-4c0f-8830-ac38ade70a78 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:28.097335 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-61a3ab81-3bdd-4c0f-8830-ac38ade70a78 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:28.104931 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-61a3ab81-3bdd-4c0f-8830-ac38ade70a78 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1498 microversion: 2.1 time: 0.184881 Nov 12 02:38:28.105754 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 672/1374] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:27 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1498 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:28.611757 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-42463aba-111c-47d3-a0b7-006caba237ef tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:28.612317 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-42463aba-111c-47d3-a0b7-006caba237ef tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:28.619419 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42463aba-111c-47d3-a0b7-006caba237ef tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:28.620167 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42463aba-111c-47d3-a0b7-006caba237ef tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:28.621289 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42463aba-111c-47d3-a0b7-006caba237ef tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:28.621855 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42463aba-111c-47d3-a0b7-006caba237ef tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:28.651451 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-42463aba-111c-47d3-a0b7-006caba237ef tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Going to try to terminate instance {{(pid=116099) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:38:28.733482 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-42463aba-111c-47d3-a0b7-006caba237ef tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "DELETE /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 204 len: 0 microversion: 2.1 time: 0.125177 Nov 12 02:38:28.734099 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 703/1375] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:38:28 2021] DELETE /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:38:28.743263 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0edff785-08fb-4677-8169-6f37fb5400cd tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:28.744266 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0edff785-08fb-4677-8169-6f37fb5400cd tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:28.750776 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0edff785-08fb-4677-8169-6f37fb5400cd tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:28.751617 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0edff785-08fb-4677-8169-6f37fb5400cd tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:28.753073 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0edff785-08fb-4677-8169-6f37fb5400cd tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:28.753644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0edff785-08fb-4677-8169-6f37fb5400cd tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:28.901689 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0edff785-08fb-4677-8169-6f37fb5400cd tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:28.910619 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0edff785-08fb-4677-8169-6f37fb5400cd tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1504 microversion: 2.1 time: 0.171710 Nov 12 02:38:28.911227 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 673/1376] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:28 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:29.931227 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2ba82870-a497-4704-b00c-6b517b66809b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:29.932666 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2ba82870-a497-4704-b00c-6b517b66809b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:29.938287 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2ba82870-a497-4704-b00c-6b517b66809b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:29.938826 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2ba82870-a497-4704-b00c-6b517b66809b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:29.939603 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2ba82870-a497-4704-b00c-6b517b66809b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:29.940786 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2ba82870-a497-4704-b00c-6b517b66809b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:30.088424 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-2ba82870-a497-4704-b00c-6b517b66809b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:30.096681 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2ba82870-a497-4704-b00c-6b517b66809b tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1504 microversion: 2.1 time: 0.169611 Nov 12 02:38:30.097440 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 704/1377] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:29 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:30.966330 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-9b817153-919b-47a0-a41a-2cf86dfbf291 req-d407c101-45e4-4e5b-830d-9df56d6f4003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975adec8-53a7-4e5b-a4fe-fe79351bf240", "name": "network-vif-deleted", "tag": "ec2fd124-4015-4517-8640-86fcfce38477"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:38:30.968581 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:38:30.968581 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:38:30.978277 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-9b817153-919b-47a0-a41a-2cf86dfbf291 req-d407c101-45e4-4e5b-830d-9df56d6f4003 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:30.978736 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-9b817153-919b-47a0-a41a-2cf86dfbf291 req-d407c101-45e4-4e5b-830d-9df56d6f4003 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:30.991501 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-9b817153-919b-47a0-a41a-2cf86dfbf291 req-d407c101-45e4-4e5b-830d-9df56d6f4003 service nova] Creating event network-vif-deleted:ec2fd124-4015-4517-8640-86fcfce38477 for instance 975adec8-53a7-4e5b-a4fe-fe79351bf240 on hv-cinder-80857 Nov 12 02:38:30.997974 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-9b817153-919b-47a0-a41a-2cf86dfbf291 req-d407c101-45e4-4e5b-830d-9df56d6f4003 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034968 Nov 12 02:38:30.998619 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 674/1378] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:38:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:38:31.115403 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-192795df-e513-4bc1-b85a-e40e8f728df3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:31.116144 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-192795df-e513-4bc1-b85a-e40e8f728df3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:31.123002 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-192795df-e513-4bc1-b85a-e40e8f728df3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:31.123555 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-192795df-e513-4bc1-b85a-e40e8f728df3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:31.124414 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-192795df-e513-4bc1-b85a-e40e8f728df3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:31.125176 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-192795df-e513-4bc1-b85a-e40e8f728df3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:31.157434 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-192795df-e513-4bc1-b85a-e40e8f728df3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:31.157877 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-192795df-e513-4bc1-b85a-e40e8f728df3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:31.158866 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-192795df-e513-4bc1-b85a-e40e8f728df3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lazy-loading 'fault' on Instance uuid 975adec8-53a7-4e5b-a4fe-fe79351bf240 {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:38:31.197682 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-192795df-e513-4bc1-b85a-e40e8f728df3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:31.204916 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-192795df-e513-4bc1-b85a-e40e8f728df3 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 200 len: 1304 microversion: 2.1 time: 0.094699 Nov 12 02:38:31.205500 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 705/1379] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:31 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:38:32.222319 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e89d7539-ce9c-4006-87ea-435a43001803 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:32.222959 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e89d7539-ce9c-4006-87ea-435a43001803 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 975adec8-53a7-4e5b-a4fe-fe79351bf240] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:32.229389 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e89d7539-ce9c-4006-87ea-435a43001803 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:32.229837 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e89d7539-ce9c-4006-87ea-435a43001803 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:32.230616 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e89d7539-ce9c-4006-87ea-435a43001803 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:32.231074 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e89d7539-ce9c-4006-87ea-435a43001803 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:32.244356 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.wsgi [None req-e89d7539-ce9c-4006-87ea-435a43001803 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] HTTP exception thrown: Instance 975adec8-53a7-4e5b-a4fe-fe79351bf240 could not be found. Nov 12 02:38:32.244989 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e89d7539-ce9c-4006-87ea-435a43001803 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Returning 404 to user: Instance 975adec8-53a7-4e5b-a4fe-fe79351bf240 could not be found. {{(pid=116098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:38:32.245831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e89d7539-ce9c-4006-87ea-435a43001803 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240" status: 404 len: 111 microversion: 2.1 time: 0.028211 Nov 12 02:38:32.246387 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 675/1380] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:32 2021] GET /compute/v2.1/servers/975adec8-53a7-4e5b-a4fe-fe79351bf240 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:38:32.341697 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1765709897", "imageRef": "78e09cfb-79fa-47e1-9449-784092b86a9a", "flavorRef": "452", "networks": [{"uuid": "334756d6-95c6-4257-b031-d266457d32e5"}]}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:38:32.395021 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.network.neutron [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] validate_networks() for [('334756d6-95c6-4257-b031-d266457d32e5', None, None, None, None, None)] {{(pid=116099) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:38:32.743092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Flavor limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:38:32.743818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Image limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:38:32.744639 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Flavor pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:38:32.745319 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Image pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:38:32.746082 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:38:32.757055 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:32.757429 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:32.758242 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:32.758700 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:32.775546 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Getting quotas for project 7982c0adc65a456e8d0410ad0672d97c. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:38:32.779457 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Getting quotas for user 2c20d82e63ab49daa5329f662888e9ca and project 7982c0adc65a456e8d0410ad0672d97c. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:38:32.791655 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Going to run 1 instances... {{(pid=116099) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:38:32.795172 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78e09cfb-79fa-47e1-9449-784092b86a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:38:32.844031 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1eca5bec-6023-4d49-b689-cd2646048f5a tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505999 Nov 12 02:38:32.844666 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 706/1381] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:38:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:38:32.854990 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b5c9694d-9d35-4abc-83b3-663226391840 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:32.855717 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b5c9694d-9d35-4abc-83b3-663226391840 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:32.921821 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b5c9694d-9d35-4abc-83b3-663226391840 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:32.929932 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b5c9694d-9d35-4abc-83b3-663226391840 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1214 microversion: 2.1 time: 0.078666 Nov 12 02:38:32.930525 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 676/1382] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:32 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:33.953487 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c09f5125-27d8-4762-b9f9-0355b85c494f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:33.955460 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c09f5125-27d8-4762-b9f9-0355b85c494f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:33.962546 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c09f5125-27d8-4762-b9f9-0355b85c494f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:33.963022 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c09f5125-27d8-4762-b9f9-0355b85c494f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:33.963950 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c09f5125-27d8-4762-b9f9-0355b85c494f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:33.964382 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c09f5125-27d8-4762-b9f9-0355b85c494f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:34.045781 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c09f5125-27d8-4762-b9f9-0355b85c494f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:34.055141 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c09f5125-27d8-4762-b9f9-0355b85c494f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1284 microversion: 2.1 time: 0.105744 Nov 12 02:38:34.055590 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 707/1383] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:33 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:35.071978 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-cd15a90c-5dd6-4375-9c04-7facd77fb4b0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:35.072594 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-cd15a90c-5dd6-4375-9c04-7facd77fb4b0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:35.080828 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd15a90c-5dd6-4375-9c04-7facd77fb4b0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:35.081376 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd15a90c-5dd6-4375-9c04-7facd77fb4b0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:35.082229 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd15a90c-5dd6-4375-9c04-7facd77fb4b0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:35.082783 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-cd15a90c-5dd6-4375-9c04-7facd77fb4b0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:35.319133 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-cd15a90c-5dd6-4375-9c04-7facd77fb4b0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:35.326535 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-cd15a90c-5dd6-4375-9c04-7facd77fb4b0 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1314 microversion: 2.1 time: 0.258286 Nov 12 02:38:35.327151 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 677/1384] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:35 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:35.683238 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-620c1676-b128-459b-a1f4-63b731159e45 req-14e90a6f-390f-4b7d-bf35-331283553df8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "710ee4bb-d829-4a48-8548-f11054bd6a38", "tag": "b509e3b2-de76-4e48-8b72-739a2442de5a"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:38:35.687278 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:38:35.687278 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:38:35.725625 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-620c1676-b128-459b-a1f4-63b731159e45 req-14e90a6f-390f-4b7d-bf35-331283553df8 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:35.726963 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-620c1676-b128-459b-a1f4-63b731159e45 req-14e90a6f-390f-4b7d-bf35-331283553df8 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:35.748496 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-620c1676-b128-459b-a1f4-63b731159e45 req-14e90a6f-390f-4b7d-bf35-331283553df8 service nova] Creating event network-changed:b509e3b2-de76-4e48-8b72-739a2442de5a for instance 710ee4bb-d829-4a48-8548-f11054bd6a38 on hv-cinder-80857 Nov 12 02:38:35.754158 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-620c1676-b128-459b-a1f4-63b731159e45 req-14e90a6f-390f-4b7d-bf35-331283553df8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078187 Nov 12 02:38:35.754796 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 708/1385] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:38:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:38:36.344304 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f1fe47eb-520e-4c39-9d52-0ce2f03ffd7f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:36.345101 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f1fe47eb-520e-4c39-9d52-0ce2f03ffd7f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:36.351874 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1fe47eb-520e-4c39-9d52-0ce2f03ffd7f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:36.352323 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1fe47eb-520e-4c39-9d52-0ce2f03ffd7f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:36.353112 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1fe47eb-520e-4c39-9d52-0ce2f03ffd7f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:36.353626 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f1fe47eb-520e-4c39-9d52-0ce2f03ffd7f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:36.612307 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f1fe47eb-520e-4c39-9d52-0ce2f03ffd7f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:36.621266 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f1fe47eb-520e-4c39-9d52-0ce2f03ffd7f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1314 microversion: 2.1 time: 0.280656 Nov 12 02:38:36.622000 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 678/1386] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:36 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:37.639092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6533f131-3e89-4310-898c-012084cf4796 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:37.639798 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6533f131-3e89-4310-898c-012084cf4796 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:37.646594 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6533f131-3e89-4310-898c-012084cf4796 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:37.647072 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6533f131-3e89-4310-898c-012084cf4796 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:37.648000 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6533f131-3e89-4310-898c-012084cf4796 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:37.648457 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6533f131-3e89-4310-898c-012084cf4796 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:37.797191 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6533f131-3e89-4310-898c-012084cf4796 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:37.804774 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6533f131-3e89-4310-898c-012084cf4796 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1314 microversion: 2.1 time: 0.170676 Nov 12 02:38:37.805374 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 709/1387] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:37 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:38.821934 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7cb9d87e-0b58-491a-8eb3-a14fbf85c313 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:38.822548 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7cb9d87e-0b58-491a-8eb3-a14fbf85c313 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:38.828429 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7cb9d87e-0b58-491a-8eb3-a14fbf85c313 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:38.828884 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7cb9d87e-0b58-491a-8eb3-a14fbf85c313 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:38.829661 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7cb9d87e-0b58-491a-8eb3-a14fbf85c313 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:38.830144 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7cb9d87e-0b58-491a-8eb3-a14fbf85c313 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:38.961734 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7cb9d87e-0b58-491a-8eb3-a14fbf85c313 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:38.969227 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7cb9d87e-0b58-491a-8eb3-a14fbf85c313 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1314 microversion: 2.1 time: 0.151317 Nov 12 02:38:38.969806 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 679/1388] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:38 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:39.985976 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-087ef511-9c6a-4934-873f-14729fc38452 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:39.986555 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-087ef511-9c6a-4934-873f-14729fc38452 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:39.993785 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-087ef511-9c6a-4934-873f-14729fc38452 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:39.994227 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-087ef511-9c6a-4934-873f-14729fc38452 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:39.995024 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-087ef511-9c6a-4934-873f-14729fc38452 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:39.995454 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-087ef511-9c6a-4934-873f-14729fc38452 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:40.133821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-087ef511-9c6a-4934-873f-14729fc38452 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:40.141108 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-087ef511-9c6a-4934-873f-14729fc38452 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1314 microversion: 2.1 time: 0.158870 Nov 12 02:38:40.141678 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 710/1389] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:39 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:41.157238 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-aa2c9175-e076-46f8-8e56-d7aaea6e6b3f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:41.157853 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-aa2c9175-e076-46f8-8e56-d7aaea6e6b3f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:41.164615 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aa2c9175-e076-46f8-8e56-d7aaea6e6b3f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:41.165069 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aa2c9175-e076-46f8-8e56-d7aaea6e6b3f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:41.165984 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aa2c9175-e076-46f8-8e56-d7aaea6e6b3f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:41.166427 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aa2c9175-e076-46f8-8e56-d7aaea6e6b3f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:41.317952 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-aa2c9175-e076-46f8-8e56-d7aaea6e6b3f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:41.325569 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-aa2c9175-e076-46f8-8e56-d7aaea6e6b3f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1314 microversion: 2.1 time: 0.171981 Nov 12 02:38:41.326138 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 680/1390] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:41 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:42.342488 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c1815b97-a88f-4406-8b10-a574d59389dc tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:42.343143 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c1815b97-a88f-4406-8b10-a574d59389dc tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:42.350151 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c1815b97-a88f-4406-8b10-a574d59389dc tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:42.350605 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c1815b97-a88f-4406-8b10-a574d59389dc tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:42.351464 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c1815b97-a88f-4406-8b10-a574d59389dc tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:42.351900 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c1815b97-a88f-4406-8b10-a574d59389dc tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:42.484512 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c1815b97-a88f-4406-8b10-a574d59389dc tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:42.492795 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c1815b97-a88f-4406-8b10-a574d59389dc tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1314 microversion: 2.1 time: 0.153777 Nov 12 02:38:42.493370 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 711/1391] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:42 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:43.509862 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a8d5737f-3153-4a19-8566-f2c93ae8106f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:43.510556 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a8d5737f-3153-4a19-8566-f2c93ae8106f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:43.517655 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8d5737f-3153-4a19-8566-f2c93ae8106f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:43.518106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8d5737f-3153-4a19-8566-f2c93ae8106f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:43.518931 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8d5737f-3153-4a19-8566-f2c93ae8106f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:43.519363 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a8d5737f-3153-4a19-8566-f2c93ae8106f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:43.658399 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a8d5737f-3153-4a19-8566-f2c93ae8106f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:43.666000 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a8d5737f-3153-4a19-8566-f2c93ae8106f tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1314 microversion: 2.1 time: 0.159704 Nov 12 02:38:43.666584 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 681/1392] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:43 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:44.683088 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8421a879-97a1-4d97-ab74-af5cf39d7dae tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:44.683762 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8421a879-97a1-4d97-ab74-af5cf39d7dae tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:44.690991 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8421a879-97a1-4d97-ab74-af5cf39d7dae tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:44.691483 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8421a879-97a1-4d97-ab74-af5cf39d7dae tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:44.692276 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8421a879-97a1-4d97-ab74-af5cf39d7dae tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:44.692710 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8421a879-97a1-4d97-ab74-af5cf39d7dae tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:44.834639 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8421a879-97a1-4d97-ab74-af5cf39d7dae tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:44.842276 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8421a879-97a1-4d97-ab74-af5cf39d7dae tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1314 microversion: 2.1 time: 0.162990 Nov 12 02:38:44.842894 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 712/1393] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:44 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:45.724845 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-56151d6d-35bd-4421-908d-3328e79e89a3 req-99d3cad8-4eed-476c-aed7-7349741b08a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710ee4bb-d829-4a48-8548-f11054bd6a38", "name": "network-vif-plugged", "status": "completed", "tag": "b509e3b2-de76-4e48-8b72-739a2442de5a"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:38:45.726449 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:38:45.726449 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:38:45.733601 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-56151d6d-35bd-4421-908d-3328e79e89a3 req-99d3cad8-4eed-476c-aed7-7349741b08a3 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:45.734047 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-56151d6d-35bd-4421-908d-3328e79e89a3 req-99d3cad8-4eed-476c-aed7-7349741b08a3 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:45.746820 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-56151d6d-35bd-4421-908d-3328e79e89a3 req-99d3cad8-4eed-476c-aed7-7349741b08a3 service nova] Creating event network-vif-plugged:b509e3b2-de76-4e48-8b72-739a2442de5a for instance 710ee4bb-d829-4a48-8548-f11054bd6a38 on hv-cinder-80857 Nov 12 02:38:45.751863 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-56151d6d-35bd-4421-908d-3328e79e89a3 req-99d3cad8-4eed-476c-aed7-7349741b08a3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221366 Nov 12 02:38:45.752459 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 682/1394] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:38:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:38:45.863260 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-f1ed30e5-3da2-41c0-8aac-fca60c7fb004 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:45.863893 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-f1ed30e5-3da2-41c0-8aac-fca60c7fb004 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:45.871474 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f1ed30e5-3da2-41c0-8aac-fca60c7fb004 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:45.872886 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f1ed30e5-3da2-41c0-8aac-fca60c7fb004 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:45.873876 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f1ed30e5-3da2-41c0-8aac-fca60c7fb004 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:45.874519 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-f1ed30e5-3da2-41c0-8aac-fca60c7fb004 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:46.107708 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-f1ed30e5-3da2-41c0-8aac-fca60c7fb004 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:46.115774 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-f1ed30e5-3da2-41c0-8aac-fca60c7fb004 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1314 microversion: 2.1 time: 0.256070 Nov 12 02:38:46.116354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 713/1395] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:45 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:47.137893 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-14153419-90fa-4c83-98e8-6712a3e043ea tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:47.138587 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-14153419-90fa-4c83-98e8-6712a3e043ea tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:47.145055 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14153419-90fa-4c83-98e8-6712a3e043ea tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:47.145513 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14153419-90fa-4c83-98e8-6712a3e043ea tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:47.146381 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14153419-90fa-4c83-98e8-6712a3e043ea tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:47.146861 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14153419-90fa-4c83-98e8-6712a3e043ea tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:47.294744 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-14153419-90fa-4c83-98e8-6712a3e043ea tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:47.305937 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-14153419-90fa-4c83-98e8-6712a3e043ea tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1314 microversion: 2.1 time: 0.171394 Nov 12 02:38:47.306547 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 683/1396] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:47 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:48.326634 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5a34df58-022c-4041-be33-45fb8884b363 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:48.327236 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5a34df58-022c-4041-be33-45fb8884b363 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:48.334509 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5a34df58-022c-4041-be33-45fb8884b363 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:48.336507 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5a34df58-022c-4041-be33-45fb8884b363 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:48.337315 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5a34df58-022c-4041-be33-45fb8884b363 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:48.337763 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5a34df58-022c-4041-be33-45fb8884b363 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:48.483048 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5a34df58-022c-4041-be33-45fb8884b363 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:48.490853 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5a34df58-022c-4041-be33-45fb8884b363 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1499 microversion: 2.1 time: 0.167933 Nov 12 02:38:48.491441 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 714/1397] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:48 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1499 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:38:49.090259 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c7cb4279-42cf-49df-9430-9091a5bfb5c7 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:49.090841 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c7cb4279-42cf-49df-9430-9091a5bfb5c7 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:49.097805 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7cb4279-42cf-49df-9430-9091a5bfb5c7 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:49.098255 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7cb4279-42cf-49df-9430-9091a5bfb5c7 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:49.099097 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7cb4279-42cf-49df-9430-9091a5bfb5c7 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:49.099533 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c7cb4279-42cf-49df-9430-9091a5bfb5c7 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:49.129116 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c7cb4279-42cf-49df-9430-9091a5bfb5c7 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:38:49.219633 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c7cb4279-42cf-49df-9430-9091a5bfb5c7 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "DELETE /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 204 len: 0 microversion: 2.1 time: 0.132679 Nov 12 02:38:49.220264 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 684/1398] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:38:49 2021] DELETE /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:38:49.228924 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ab7f975e-55df-4119-8c04-e37adb85ce54 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:49.229531 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ab7f975e-55df-4119-8c04-e37adb85ce54 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:49.235569 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ab7f975e-55df-4119-8c04-e37adb85ce54 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:49.236013 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ab7f975e-55df-4119-8c04-e37adb85ce54 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:49.236791 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ab7f975e-55df-4119-8c04-e37adb85ce54 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:49.237224 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ab7f975e-55df-4119-8c04-e37adb85ce54 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:49.379949 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ab7f975e-55df-4119-8c04-e37adb85ce54 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:49.388420 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ab7f975e-55df-4119-8c04-e37adb85ce54 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1505 microversion: 2.1 time: 0.162784 Nov 12 02:38:49.389465 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 715/1399] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:49 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:50.412158 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e86574c2-b323-4551-86ff-0b4d42d9cd21 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:50.412813 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e86574c2-b323-4551-86ff-0b4d42d9cd21 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:50.419346 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e86574c2-b323-4551-86ff-0b4d42d9cd21 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:50.419815 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e86574c2-b323-4551-86ff-0b4d42d9cd21 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:50.420596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e86574c2-b323-4551-86ff-0b4d42d9cd21 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:50.421030 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e86574c2-b323-4551-86ff-0b4d42d9cd21 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:50.562334 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e86574c2-b323-4551-86ff-0b4d42d9cd21 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:50.570261 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e86574c2-b323-4551-86ff-0b4d42d9cd21 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1505 microversion: 2.1 time: 0.163302 Nov 12 02:38:50.570864 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 685/1400] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:50 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:38:51.588013 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ff71537b-4678-4645-9a68-45eb439fb565 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:51.588638 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ff71537b-4678-4645-9a68-45eb439fb565 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:51.595679 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ff71537b-4678-4645-9a68-45eb439fb565 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:51.596129 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ff71537b-4678-4645-9a68-45eb439fb565 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:51.596908 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ff71537b-4678-4645-9a68-45eb439fb565 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:51.597335 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ff71537b-4678-4645-9a68-45eb439fb565 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:51.810011 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-5d7a20d0-79eb-416e-b214-f3e4112d26d6 req-f9eeaacc-7fd7-4db2-b905-a9ca84091caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710ee4bb-d829-4a48-8548-f11054bd6a38", "name": "network-vif-deleted", "tag": "b509e3b2-de76-4e48-8b72-739a2442de5a"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:38:51.811744 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:38:51.811744 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:38:51.824404 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-5d7a20d0-79eb-416e-b214-f3e4112d26d6 req-f9eeaacc-7fd7-4db2-b905-a9ca84091caa service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:51.825200 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-5d7a20d0-79eb-416e-b214-f3e4112d26d6 req-f9eeaacc-7fd7-4db2-b905-a9ca84091caa service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:51.839105 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-5d7a20d0-79eb-416e-b214-f3e4112d26d6 req-f9eeaacc-7fd7-4db2-b905-a9ca84091caa service nova] Creating event network-vif-deleted:b509e3b2-de76-4e48-8b72-739a2442de5a for instance 710ee4bb-d829-4a48-8548-f11054bd6a38 on hv-cinder-80857 Nov 12 02:38:51.844707 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ff71537b-4678-4645-9a68-45eb439fb565 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c20d82e63ab49daa5329f662888e9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7982c0adc65a456e8d0410ad0672d97c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:38:51.856695 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-5d7a20d0-79eb-416e-b214-f3e4112d26d6 req-f9eeaacc-7fd7-4db2-b905-a9ca84091caa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051404 Nov 12 02:38:51.859977 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ff71537b-4678-4645-9a68-45eb439fb565 tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 200 len: 1505 microversion: 2.1 time: 0.275756 Nov 12 02:38:51.860749 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 716/1401] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:51 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 1505 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:38:51.861143 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 686/1402] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:38:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:38:52.877831 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8e88a7db-01fb-407b-a0a8-ef8e5a71fb6e tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:38:52.878453 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8e88a7db-01fb-407b-a0a8-ef8e5a71fb6e tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] [instance: 710ee4bb-d829-4a48-8548-f11054bd6a38] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:38:52.886620 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e88a7db-01fb-407b-a0a8-ef8e5a71fb6e tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:52.887430 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e88a7db-01fb-407b-a0a8-ef8e5a71fb6e tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:52.889069 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e88a7db-01fb-407b-a0a8-ef8e5a71fb6e tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:38:52.889069 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8e88a7db-01fb-407b-a0a8-ef8e5a71fb6e tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:38:52.908700 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-8e88a7db-01fb-407b-a0a8-ef8e5a71fb6e tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] HTTP exception thrown: Instance 710ee4bb-d829-4a48-8548-f11054bd6a38 could not be found. Nov 12 02:38:52.909305 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8e88a7db-01fb-407b-a0a8-ef8e5a71fb6e tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] Returning 404 to user: Instance 710ee4bb-d829-4a48-8548-f11054bd6a38 could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:38:52.910144 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8e88a7db-01fb-407b-a0a8-ef8e5a71fb6e tempest-VolumesActionsTest-16622081 tempest-VolumesActionsTest-16622081-project] 10.222.0.70 "GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38" status: 404 len: 111 microversion: 2.1 time: 0.036649 Nov 12 02:38:52.910775 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 717/1403] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:38:52 2021] GET /compute/v2.1/servers/710ee4bb-d829-4a48-8548-f11054bd6a38 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:39:34.425470 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:39:34.425470 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: Fri Nov 12 02:39:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:39:42.142042 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-91dc1798-4d2b-46b6-bb36-1d1be3ad2e71 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Action: 'create', calling method: .version_select at 0x7fc0646655e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1890216270"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:39:42.158644 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-91dc1798-4d2b-46b6-bb36-1d1be3ad2e71 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Getting quotas for project c863d2b5a6444d01a46426976b87632b. Resources: {'key_pairs'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:39:42.162556 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-91dc1798-4d2b-46b6-bb36-1d1be3ad2e71 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Getting quotas for user 3e3831cdcdfd4cbbb736e88317c0eaf5 and project c863d2b5a6444d01a46426976b87632b. Resources: {'key_pairs'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:39:42.438510 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-91dc1798-4d2b-46b6-bb36-1d1be3ad2e71 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Getting quotas for project c863d2b5a6444d01a46426976b87632b. Resources: {'key_pairs'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:39:42.442269 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-91dc1798-4d2b-46b6-bb36-1d1be3ad2e71 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Getting quotas for user 3e3831cdcdfd4cbbb736e88317c0eaf5 and project c863d2b5a6444d01a46426976b87632b. Resources: {'key_pairs'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:39:42.455726 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-91dc1798-4d2b-46b6-bb36-1d1be3ad2e71 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.318456 Nov 12 02:39:42.456215 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 687/1404] 10.222.0.70 () {60 vars in 1157 bytes} [Fri Nov 12 02:39:42 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:42.504495 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1618088437", "imageRef": "74d8f549-786f-4200-bdf4-1c7166143ba2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1890216270", "networks": [{"uuid": "babc3499-34b6-4659-a1c7-3e703b29209b"}]}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:39:42.555340 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.network.neutron [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] validate_networks() for [('babc3499-34b6-4659-a1c7-3e703b29209b', None, None, None, None, None)] {{(pid=116099) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:39:42.932724 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Flavor limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:39:42.933151 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Image limits 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:39:42.933654 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Flavor pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:39:42.934067 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Image pref 0:0:0 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:39:42.934479 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.virt.hardware [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:39:42.945658 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:42.946167 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:42.947036 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:42.947473 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:42.965541 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Getting quotas for project c863d2b5a6444d01a46426976b87632b. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:39:42.969698 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Getting quotas for user 3e3831cdcdfd4cbbb736e88317c0eaf5 and project c863d2b5a6444d01a46426976b87632b. Resources: {'instances', 'cores', 'ram'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:39:42.981308 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Going to run 1 instances... {{(pid=116099) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:39:42.983679 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='74d8f549-786f-4200-bdf4-1c7166143ba2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:39:43.031832 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ebbd63d3-7009-4ee4-b903-4bb9839b68ff tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531221 Nov 12 02:39:43.032485 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 718/1405] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:39:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:39:43.042798 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-b54800b0-7482-4d11-8444-2d4aca929c4e tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:43.043537 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-b54800b0-7482-4d11-8444-2d4aca929c4e tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:43.100945 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-b54800b0-7482-4d11-8444-2d4aca929c4e tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:43.108203 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-b54800b0-7482-4d11-8444-2d4aca929c4e tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1259 microversion: 2.1 time: 0.069093 Nov 12 02:39:43.108778 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 688/1406] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:43 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:44.126170 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-ce5a88b5-f462-4e8b-bef9-fbd27729c0f6 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:44.126975 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-ce5a88b5-f462-4e8b-bef9-fbd27729c0f6 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:44.133341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ce5a88b5-f462-4e8b-bef9-fbd27729c0f6 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:44.133916 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ce5a88b5-f462-4e8b-bef9-fbd27729c0f6 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:44.134820 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ce5a88b5-f462-4e8b-bef9-fbd27729c0f6 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:44.135333 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-ce5a88b5-f462-4e8b-bef9-fbd27729c0f6 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:44.228964 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-ce5a88b5-f462-4e8b-bef9-fbd27729c0f6 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:44.236747 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-ce5a88b5-f462-4e8b-bef9-fbd27729c0f6 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1329 microversion: 2.1 time: 0.115021 Nov 12 02:39:44.237422 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 719/1407] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:44 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1329 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:45.254907 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-309d7894-0ba8-467e-8430-0a7d7990291c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:45.255515 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-309d7894-0ba8-467e-8430-0a7d7990291c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:45.262273 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-309d7894-0ba8-467e-8430-0a7d7990291c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:45.262757 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-309d7894-0ba8-467e-8430-0a7d7990291c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:45.263563 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-309d7894-0ba8-467e-8430-0a7d7990291c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:45.264006 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-309d7894-0ba8-467e-8430-0a7d7990291c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:45.414735 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-309d7894-0ba8-467e-8430-0a7d7990291c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:45.422979 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-309d7894-0ba8-467e-8430-0a7d7990291c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.172281 Nov 12 02:39:45.424473 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 689/1408] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:45 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:46.440901 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-cf2aa52e-6aba-4c68-be08-72518c45ae9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:46.441533 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-cf2aa52e-6aba-4c68-be08-72518c45ae9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:46.447950 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cf2aa52e-6aba-4c68-be08-72518c45ae9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:46.448395 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cf2aa52e-6aba-4c68-be08-72518c45ae9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:46.449192 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cf2aa52e-6aba-4c68-be08-72518c45ae9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:46.449625 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cf2aa52e-6aba-4c68-be08-72518c45ae9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:46.599591 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cf2aa52e-6aba-4c68-be08-72518c45ae9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:46.606781 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-cf2aa52e-6aba-4c68-be08-72518c45ae9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.169667 Nov 12 02:39:46.607344 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 720/1409] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:46 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:47.624284 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c0ed6dcf-c708-4960-a5a9-cba9adbb2578 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:47.626201 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c0ed6dcf-c708-4960-a5a9-cba9adbb2578 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:47.637364 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c0ed6dcf-c708-4960-a5a9-cba9adbb2578 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:47.639184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c0ed6dcf-c708-4960-a5a9-cba9adbb2578 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:47.640174 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c0ed6dcf-c708-4960-a5a9-cba9adbb2578 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:47.640614 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c0ed6dcf-c708-4960-a5a9-cba9adbb2578 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:47.802437 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c0ed6dcf-c708-4960-a5a9-cba9adbb2578 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:47.810359 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c0ed6dcf-c708-4960-a5a9-cba9adbb2578 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.189660 Nov 12 02:39:47.811304 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 690/1410] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:47 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:48.828634 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-56b0edcc-b203-4198-89c5-2a1e2f9aaf20 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:48.829443 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-56b0edcc-b203-4198-89c5-2a1e2f9aaf20 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:48.837490 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-56b0edcc-b203-4198-89c5-2a1e2f9aaf20 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:48.837942 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-56b0edcc-b203-4198-89c5-2a1e2f9aaf20 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:48.838771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-56b0edcc-b203-4198-89c5-2a1e2f9aaf20 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:48.839210 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-56b0edcc-b203-4198-89c5-2a1e2f9aaf20 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:48.999873 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-56b0edcc-b203-4198-89c5-2a1e2f9aaf20 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:49.012399 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-56b0edcc-b203-4198-89c5-2a1e2f9aaf20 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.185991 Nov 12 02:39:49.012991 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 721/1411] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:48 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:50.029886 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f57bdaa6-48b2-46b1-b6cb-5ce5d69a9332 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:50.030582 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f57bdaa6-48b2-46b1-b6cb-5ce5d69a9332 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:50.038774 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f57bdaa6-48b2-46b1-b6cb-5ce5d69a9332 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:50.039231 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f57bdaa6-48b2-46b1-b6cb-5ce5d69a9332 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:50.040034 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f57bdaa6-48b2-46b1-b6cb-5ce5d69a9332 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:50.040472 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f57bdaa6-48b2-46b1-b6cb-5ce5d69a9332 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:50.186575 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f57bdaa6-48b2-46b1-b6cb-5ce5d69a9332 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:50.198731 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f57bdaa6-48b2-46b1-b6cb-5ce5d69a9332 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.172393 Nov 12 02:39:50.199894 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 691/1412] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:50 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:51.217103 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-64d35865-0817-43b3-874d-3238f98da8f9 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:51.218026 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-64d35865-0817-43b3-874d-3238f98da8f9 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:51.224612 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-64d35865-0817-43b3-874d-3238f98da8f9 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:51.225646 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-64d35865-0817-43b3-874d-3238f98da8f9 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:51.226512 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-64d35865-0817-43b3-874d-3238f98da8f9 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:51.227045 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-64d35865-0817-43b3-874d-3238f98da8f9 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:51.377959 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-64d35865-0817-43b3-874d-3238f98da8f9 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:51.387627 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-64d35865-0817-43b3-874d-3238f98da8f9 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.174368 Nov 12 02:39:51.397735 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 722/1413] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:51 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:52.415656 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-125f2f13-a6cf-4489-a729-2565691c4634 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:52.416491 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-125f2f13-a6cf-4489-a729-2565691c4634 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:52.422409 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-125f2f13-a6cf-4489-a729-2565691c4634 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:52.422900 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-125f2f13-a6cf-4489-a729-2565691c4634 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:52.424303 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-125f2f13-a6cf-4489-a729-2565691c4634 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:52.424744 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-125f2f13-a6cf-4489-a729-2565691c4634 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:52.572940 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-125f2f13-a6cf-4489-a729-2565691c4634 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:52.581396 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-125f2f13-a6cf-4489-a729-2565691c4634 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.169880 Nov 12 02:39:52.582187 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 692/1414] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:52 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:39:53.598756 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-22d787bd-c770-43be-855a-863ebd7b2d48 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:53.599431 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-22d787bd-c770-43be-855a-863ebd7b2d48 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:53.607671 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-22d787bd-c770-43be-855a-863ebd7b2d48 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:53.608394 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-22d787bd-c770-43be-855a-863ebd7b2d48 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:53.609193 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-22d787bd-c770-43be-855a-863ebd7b2d48 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:53.609623 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-22d787bd-c770-43be-855a-863ebd7b2d48 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:53.786760 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-22d787bd-c770-43be-855a-863ebd7b2d48 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:53.794309 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-22d787bd-c770-43be-855a-863ebd7b2d48 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.199466 Nov 12 02:39:53.795016 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 723/1415] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:53 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:54.814397 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3d14e80d-0bee-478a-affb-4f48f25b76db tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:54.815314 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3d14e80d-0bee-478a-affb-4f48f25b76db tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:54.821715 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3d14e80d-0bee-478a-affb-4f48f25b76db tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:54.822166 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3d14e80d-0bee-478a-affb-4f48f25b76db tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:54.822985 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3d14e80d-0bee-478a-affb-4f48f25b76db tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:54.823421 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3d14e80d-0bee-478a-affb-4f48f25b76db tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:54.959535 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3d14e80d-0bee-478a-affb-4f48f25b76db tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:54.966995 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3d14e80d-0bee-478a-affb-4f48f25b76db tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.158585 Nov 12 02:39:54.967569 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 693/1416] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:54 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:55.983741 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-6bdac7f8-8c37-49d0-89b9-a7e3675f569f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:55.984375 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-6bdac7f8-8c37-49d0-89b9-a7e3675f569f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:55.991311 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6bdac7f8-8c37-49d0-89b9-a7e3675f569f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:55.991753 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6bdac7f8-8c37-49d0-89b9-a7e3675f569f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:55.992536 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6bdac7f8-8c37-49d0-89b9-a7e3675f569f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:55.993237 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-6bdac7f8-8c37-49d0-89b9-a7e3675f569f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:56.127450 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-6bdac7f8-8c37-49d0-89b9-a7e3675f569f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:56.134910 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-6bdac7f8-8c37-49d0-89b9-a7e3675f569f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.154783 Nov 12 02:39:56.135491 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 724/1417] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:55 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:57.152567 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ebd65fbd-f1d7-478c-b30f-b120bb8266b0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:57.153191 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ebd65fbd-f1d7-478c-b30f-b120bb8266b0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:57.160208 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ebd65fbd-f1d7-478c-b30f-b120bb8266b0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:57.160666 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ebd65fbd-f1d7-478c-b30f-b120bb8266b0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:57.161462 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ebd65fbd-f1d7-478c-b30f-b120bb8266b0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:57.161896 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ebd65fbd-f1d7-478c-b30f-b120bb8266b0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:57.299492 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ebd65fbd-f1d7-478c-b30f-b120bb8266b0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:57.307071 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ebd65fbd-f1d7-478c-b30f-b120bb8266b0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.158444 Nov 12 02:39:57.307652 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 694/1418] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:57 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:58.044182 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-64f9afcd-725d-40d9-a8aa-e7ef093e9288 req-79eaeb21-6d8b-423f-a07a-c54f19c58c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc0df28-0c70-4056-8f47-74774e043cba", "tag": "38e80ebc-90b9-4664-a8b5-b860fd8e892f"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:39:58.045747 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:39:58.045747 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:39:58.053138 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-64f9afcd-725d-40d9-a8aa-e7ef093e9288 req-79eaeb21-6d8b-423f-a07a-c54f19c58c71 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:58.053606 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-64f9afcd-725d-40d9-a8aa-e7ef093e9288 req-79eaeb21-6d8b-423f-a07a-c54f19c58c71 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:58.065874 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-64f9afcd-725d-40d9-a8aa-e7ef093e9288 req-79eaeb21-6d8b-423f-a07a-c54f19c58c71 service nova] Creating event network-changed:38e80ebc-90b9-4664-a8b5-b860fd8e892f for instance bdc0df28-0c70-4056-8f47-74774e043cba on hv-cinder-80857 Nov 12 02:39:58.071730 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-64f9afcd-725d-40d9-a8aa-e7ef093e9288 req-79eaeb21-6d8b-423f-a07a-c54f19c58c71 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031033 Nov 12 02:39:58.072499 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 725/1419] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:39:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:39:58.323716 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-653b220d-8fcb-4f06-b3e7-7c5b6409006d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:58.324282 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-653b220d-8fcb-4f06-b3e7-7c5b6409006d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:58.331129 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-653b220d-8fcb-4f06-b3e7-7c5b6409006d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:58.331683 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-653b220d-8fcb-4f06-b3e7-7c5b6409006d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:58.332554 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-653b220d-8fcb-4f06-b3e7-7c5b6409006d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:58.333050 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-653b220d-8fcb-4f06-b3e7-7c5b6409006d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:58.531548 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-653b220d-8fcb-4f06-b3e7-7c5b6409006d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:58.539333 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-653b220d-8fcb-4f06-b3e7-7c5b6409006d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.219382 Nov 12 02:39:58.539931 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 695/1420] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:58 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:39:59.558248 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e9dc13f5-efb7-4b8c-acf9-9835fecc945f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:39:59.558905 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e9dc13f5-efb7-4b8c-acf9-9835fecc945f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:39:59.565777 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e9dc13f5-efb7-4b8c-acf9-9835fecc945f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:59.566225 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e9dc13f5-efb7-4b8c-acf9-9835fecc945f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:59.567049 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e9dc13f5-efb7-4b8c-acf9-9835fecc945f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:39:59.567531 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e9dc13f5-efb7-4b8c-acf9-9835fecc945f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:39:59.710229 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e9dc13f5-efb7-4b8c-acf9-9835fecc945f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:39:59.719185 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e9dc13f5-efb7-4b8c-acf9-9835fecc945f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.165390 Nov 12 02:39:59.719771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 726/1421] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:39:59 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:40:00.736924 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0bfb3e67-b17d-4383-ab9b-ed7aa0899c9b tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:40:00.737550 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0bfb3e67-b17d-4383-ab9b-ed7aa0899c9b tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:40:00.744075 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0bfb3e67-b17d-4383-ab9b-ed7aa0899c9b tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:00.744519 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0bfb3e67-b17d-4383-ab9b-ed7aa0899c9b tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:00.745292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0bfb3e67-b17d-4383-ab9b-ed7aa0899c9b tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:00.745721 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0bfb3e67-b17d-4383-ab9b-ed7aa0899c9b tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:00.892594 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0bfb3e67-b17d-4383-ab9b-ed7aa0899c9b tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:40:00.900056 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0bfb3e67-b17d-4383-ab9b-ed7aa0899c9b tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.166835 Nov 12 02:40:00.900632 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 696/1422] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:40:00 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:40:01.917539 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-841de335-96ca-46a8-a380-ad965b36f0f1 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:40:01.918154 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-841de335-96ca-46a8-a380-ad965b36f0f1 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:40:01.925848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-841de335-96ca-46a8-a380-ad965b36f0f1 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:01.926177 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-841de335-96ca-46a8-a380-ad965b36f0f1 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:01.926987 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-841de335-96ca-46a8-a380-ad965b36f0f1 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:01.927420 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-841de335-96ca-46a8-a380-ad965b36f0f1 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:02.060256 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-841de335-96ca-46a8-a380-ad965b36f0f1 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:40:02.068233 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-841de335-96ca-46a8-a380-ad965b36f0f1 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.154686 Nov 12 02:40:02.068818 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 727/1423] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:40:01 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:40:03.085201 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-dedb5c78-c32e-43cc-a3cd-7615c53b577d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:40:03.085768 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-dedb5c78-c32e-43cc-a3cd-7615c53b577d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:40:03.092168 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dedb5c78-c32e-43cc-a3cd-7615c53b577d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:03.092607 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dedb5c78-c32e-43cc-a3cd-7615c53b577d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:03.093407 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dedb5c78-c32e-43cc-a3cd-7615c53b577d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:03.093840 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-dedb5c78-c32e-43cc-a3cd-7615c53b577d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:03.230899 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-dedb5c78-c32e-43cc-a3cd-7615c53b577d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:40:03.247340 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-dedb5c78-c32e-43cc-a3cd-7615c53b577d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.165800 Nov 12 02:40:03.247931 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 697/1424] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:40:03 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:40:03.947120 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-e8e908a4-bfbe-4028-81da-f393044bb197 req-12c5ad5e-406d-4259-a051-3a17b8ae6ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc0df28-0c70-4056-8f47-74774e043cba", "name": "network-vif-plugged", "status": "completed", "tag": "38e80ebc-90b9-4664-a8b5-b860fd8e892f"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:40:03.948712 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:40:03.948712 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:40:03.957862 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-e8e908a4-bfbe-4028-81da-f393044bb197 req-12c5ad5e-406d-4259-a051-3a17b8ae6ce3 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:03.958779 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-e8e908a4-bfbe-4028-81da-f393044bb197 req-12c5ad5e-406d-4259-a051-3a17b8ae6ce3 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:03.973951 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-e8e908a4-bfbe-4028-81da-f393044bb197 req-12c5ad5e-406d-4259-a051-3a17b8ae6ce3 service nova] Creating event network-vif-plugged:38e80ebc-90b9-4664-a8b5-b860fd8e892f for instance bdc0df28-0c70-4056-8f47-74774e043cba on hv-cinder-80857 Nov 12 02:40:03.979322 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-e8e908a4-bfbe-4028-81da-f393044bb197 req-12c5ad5e-406d-4259-a051-3a17b8ae6ce3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035758 Nov 12 02:40:03.979928 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 728/1425] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:40:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:40:04.270564 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-248ba0ef-ba1c-40ce-afb3-d994142407e4 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:40:04.271209 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-248ba0ef-ba1c-40ce-afb3-d994142407e4 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:40:04.277557 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-248ba0ef-ba1c-40ce-afb3-d994142407e4 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:04.278001 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-248ba0ef-ba1c-40ce-afb3-d994142407e4 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:04.278821 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-248ba0ef-ba1c-40ce-afb3-d994142407e4 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:04.279254 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-248ba0ef-ba1c-40ce-afb3-d994142407e4 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:04.417371 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-248ba0ef-ba1c-40ce-afb3-d994142407e4 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:40:04.425304 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-248ba0ef-ba1c-40ce-afb3-d994142407e4 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.158366 Nov 12 02:40:04.425874 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 698/1426] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:40:04 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:40:05.443078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3375b8a4-367b-4ea9-af71-3c5af9847668 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:40:05.443717 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3375b8a4-367b-4ea9-af71-3c5af9847668 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:40:05.449876 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3375b8a4-367b-4ea9-af71-3c5af9847668 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:05.450325 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3375b8a4-367b-4ea9-af71-3c5af9847668 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:05.451134 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3375b8a4-367b-4ea9-af71-3c5af9847668 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:05.451571 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3375b8a4-367b-4ea9-af71-3c5af9847668 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:05.591301 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3375b8a4-367b-4ea9-af71-3c5af9847668 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:40:05.599769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3375b8a4-367b-4ea9-af71-3c5af9847668 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1359 microversion: 2.1 time: 0.161768 Nov 12 02:40:05.600330 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 729/1427] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:40:05 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:40:06.617421 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-02ff84e0-5be2-40c7-b6e1-7b636f383c6f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:40:06.618289 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-02ff84e0-5be2-40c7-b6e1-7b636f383c6f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:40:06.624947 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02ff84e0-5be2-40c7-b6e1-7b636f383c6f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:06.625391 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02ff84e0-5be2-40c7-b6e1-7b636f383c6f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:06.626170 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02ff84e0-5be2-40c7-b6e1-7b636f383c6f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:06.626596 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-02ff84e0-5be2-40c7-b6e1-7b636f383c6f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:06.764916 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-02ff84e0-5be2-40c7-b6e1-7b636f383c6f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:40:06.772807 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-02ff84e0-5be2-40c7-b6e1-7b636f383c6f tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1549 microversion: 2.1 time: 0.159096 Nov 12 02:40:06.773370 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 699/1428] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:40:06 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:40:06.789078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0fd12c07-6f53-43d2-be6e-be7ccbf351ed tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:40:06.789691 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0fd12c07-6f53-43d2-be6e-be7ccbf351ed tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:40:06.796093 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0fd12c07-6f53-43d2-be6e-be7ccbf351ed tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:06.796549 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0fd12c07-6f53-43d2-be6e-be7ccbf351ed tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:06.797332 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0fd12c07-6f53-43d2-be6e-be7ccbf351ed tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:06.797771 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0fd12c07-6f53-43d2-be6e-be7ccbf351ed tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:06.934291 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-0fd12c07-6f53-43d2-be6e-be7ccbf351ed tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:40:06.941828 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0fd12c07-6f53-43d2-be6e-be7ccbf351ed tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1549 microversion: 2.1 time: 0.156355 Nov 12 02:40:06.942391 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 730/1429] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:40:06 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:40:06.957862 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-bfc9a61b-998b-403f-a0c9-2b0f8a69de87 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:40:06.961239 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:40:06.961239 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:40:06.962229 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-bfc9a61b-998b-403f-a0c9-2b0f8a69de87 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:40:06.962998 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-bfc9a61b-998b-403f-a0c9-2b0f8a69de87 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Searching by: {'deleted': False, 'project_id': 'c863d2b5a6444d01a46426976b87632b'} {{(pid=116098) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 12 02:40:06.969583 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bfc9a61b-998b-403f-a0c9-2b0f8a69de87 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:06.970612 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bfc9a61b-998b-403f-a0c9-2b0f8a69de87 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:06.971428 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bfc9a61b-998b-403f-a0c9-2b0f8a69de87 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:06.971857 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-bfc9a61b-998b-403f-a0c9-2b0f8a69de87 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:07.060403 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.multi_cell_list [None req-bfc9a61b-998b-403f-a0c9-2b0f8a69de87 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116098) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 12 02:40:07.164181 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-bfc9a61b-998b-403f-a0c9-2b0f8a69de87 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210455 Nov 12 02:40:07.164765 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 700/1430] 10.222.0.70 () {58 vars in 1124 bytes} [Fri Nov 12 02:40:06 2021] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:40:07.175537 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d1bb8b48-df8e-440f-bf58-3844d127ef49 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:40:07.176150 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d1bb8b48-df8e-440f-bf58-3844d127ef49 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:40:07.182117 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1bb8b48-df8e-440f-bf58-3844d127ef49 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:07.182573 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1bb8b48-df8e-440f-bf58-3844d127ef49 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:07.183386 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1bb8b48-df8e-440f-bf58-3844d127ef49 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:07.183827 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d1bb8b48-df8e-440f-bf58-3844d127ef49 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:07.315834 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d1bb8b48-df8e-440f-bf58-3844d127ef49 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:40:07.323225 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d1bb8b48-df8e-440f-bf58-3844d127ef49 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1549 microversion: 2.1 time: 0.152247 Nov 12 02:40:07.323800 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 731/1431] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:40:07 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:40:08.825598 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a6656cbc-bb62-4de5-8bac-54ad425063d3 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "696ae3c2-a42f-41a0-a76d-ca3b17847f7d"}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:40:08.826659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a6656cbc-bb62-4de5-8bac-54ad425063d3 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:40:08.832752 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6656cbc-bb62-4de5-8bac-54ad425063d3 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:08.833203 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6656cbc-bb62-4de5-8bac-54ad425063d3 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:08.833997 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6656cbc-bb62-4de5-8bac-54ad425063d3 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:08.834436 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a6656cbc-bb62-4de5-8bac-54ad425063d3 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:09.084691 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a6656cbc-bb62-4de5-8bac-54ad425063d3 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "POST /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262928 Nov 12 02:40:09.085311 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 701/1432] 10.222.0.70 () {60 vars in 1322 bytes} [Fri Nov 12 02:40:08 2021] POST /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:40:16.602321 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-d3d56c77-e6c3-4587-82bf-0fcfe9c84b78 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:40:16.603031 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-d3d56c77-e6c3-4587-82bf-0fcfe9c84b78 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:40:16.611164 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d3d56c77-e6c3-4587-82bf-0fcfe9c84b78 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:16.611610 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d3d56c77-e6c3-4587-82bf-0fcfe9c84b78 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:16.612463 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d3d56c77-e6c3-4587-82bf-0fcfe9c84b78 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:16.612946 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-d3d56c77-e6c3-4587-82bf-0fcfe9c84b78 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:16.750586 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-d3d56c77-e6c3-4587-82bf-0fcfe9c84b78 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:40:16.759243 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-d3d56c77-e6c3-4587-82bf-0fcfe9c84b78 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1595 microversion: 2.1 time: 0.160746 Nov 12 02:40:16.759825 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 732/1433] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:40:16 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1595 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:40:18.763161 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-8f05ad63-6553-4996-86f7-5a040482b27a req-f2fa3db7-69c3-4878-be5f-b23210cbc3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc0df28-0c70-4056-8f47-74774e043cba", "tag": "38e80ebc-90b9-4664-a8b5-b860fd8e892f"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:40:18.765339 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:40:18.765339 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:40:18.773643 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-8f05ad63-6553-4996-86f7-5a040482b27a req-f2fa3db7-69c3-4878-be5f-b23210cbc3e6 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:18.774650 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-8f05ad63-6553-4996-86f7-5a040482b27a req-f2fa3db7-69c3-4878-be5f-b23210cbc3e6 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:18.792303 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-8f05ad63-6553-4996-86f7-5a040482b27a req-f2fa3db7-69c3-4878-be5f-b23210cbc3e6 service nova] Creating event network-changed:38e80ebc-90b9-4664-a8b5-b860fd8e892f for instance bdc0df28-0c70-4056-8f47-74774e043cba on hv-cinder-80857 Nov 12 02:40:18.799221 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-8f05ad63-6553-4996-86f7-5a040482b27a req-f2fa3db7-69c3-4878-be5f-b23210cbc3e6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040253 Nov 12 02:40:18.799902 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 702/1434] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:40:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:40:19.941397 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5c5a71a9-adbc-4fab-8269-d11858ac0f9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-954143246"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:40:19.941936 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5c5a71a9-adbc-4fab-8269-d11858ac0f9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:40:19.949645 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5c5a71a9-adbc-4fab-8269-d11858ac0f9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:19.950101 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5c5a71a9-adbc-4fab-8269-d11858ac0f9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:19.951016 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5c5a71a9-adbc-4fab-8269-d11858ac0f9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:19.951455 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5c5a71a9-adbc-4fab-8269-d11858ac0f9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:20.111954 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.network.security_group_api [None req-5c5a71a9-adbc-4fab-8269-d11858ac0f9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Adding security group b1e31fb8-6a09-4bfb-aea9-2d1a1cfd7556 to port 38e80ebc-90b9-4664-a8b5-b860fd8e892f Nov 12 02:40:20.478180 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5c5a71a9-adbc-4fab-8269-d11858ac0f9c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "POST /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/action" status: 202 len: 0 microversion: 2.1 time: 0.541086 Nov 12 02:40:20.482807 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 733/1435] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:40:19 2021] POST /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:40:20.491590 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d2147c2c-2e7c-4a96-8759-3a9d8aa7aa41 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:40:20.492342 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d2147c2c-2e7c-4a96-8759-3a9d8aa7aa41 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:40:20.498763 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-525823b8-13d4-47a9-a4f9-130c6000308f req-b67e5322-5b6e-47a7-a0f1-3fc4e06e4fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc0df28-0c70-4056-8f47-74774e043cba", "tag": "38e80ebc-90b9-4664-a8b5-b860fd8e892f"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:40:20.500470 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:40:20.500470 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:40:20.508059 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2147c2c-2e7c-4a96-8759-3a9d8aa7aa41 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:20.508919 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2147c2c-2e7c-4a96-8759-3a9d8aa7aa41 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:20.509917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2147c2c-2e7c-4a96-8759-3a9d8aa7aa41 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:20.510526 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2147c2c-2e7c-4a96-8759-3a9d8aa7aa41 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:20.512820 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-525823b8-13d4-47a9-a4f9-130c6000308f req-b67e5322-5b6e-47a7-a0f1-3fc4e06e4fb5 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:40:20.513148 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-525823b8-13d4-47a9-a4f9-130c6000308f req-b67e5322-5b6e-47a7-a0f1-3fc4e06e4fb5 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:40:20.533240 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-525823b8-13d4-47a9-a4f9-130c6000308f req-b67e5322-5b6e-47a7-a0f1-3fc4e06e4fb5 service nova] Creating event network-changed:38e80ebc-90b9-4664-a8b5-b860fd8e892f for instance bdc0df28-0c70-4056-8f47-74774e043cba on hv-cinder-80857 Nov 12 02:40:20.539674 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-525823b8-13d4-47a9-a4f9-130c6000308f req-b67e5322-5b6e-47a7-a0f1-3fc4e06e4fb5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044325 Nov 12 02:40:20.540285 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 734/1436] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:40:20.790386 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d2147c2c-2e7c-4a96-8759-3a9d8aa7aa41 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:40:20.800698 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d2147c2c-2e7c-4a96-8759-3a9d8aa7aa41 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1759 microversion: 2.1 time: 0.313959 Nov 12 02:40:20.801544 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 703/1437] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:40:20 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1759 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:41:20.671848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:41:20.672511 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: Fri Nov 12 02:41:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:41:21.520761 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4d08b400-78fa-48e1-9b56-948bf84b24d7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:41:21.521718 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4d08b400-78fa-48e1-9b56-948bf84b24d7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:41:21.527829 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4d08b400-78fa-48e1-9b56-948bf84b24d7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:21.528272 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4d08b400-78fa-48e1-9b56-948bf84b24d7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:21.529036 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4d08b400-78fa-48e1-9b56-948bf84b24d7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:21.529463 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4d08b400-78fa-48e1-9b56-948bf84b24d7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:21.601042 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4d08b400-78fa-48e1-9b56-948bf84b24d7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "POST /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/action" status: 202 len: 0 microversion: 2.1 time: 0.085904 Nov 12 02:41:21.601712 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 735/1438] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:41:21 2021] POST /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:41:21.612062 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-350e55b9-5bbc-4a99-aacb-58f2e4c8c63c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:41:21.613292 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-350e55b9-5bbc-4a99-aacb-58f2e4c8c63c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:41:21.620095 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-350e55b9-5bbc-4a99-aacb-58f2e4c8c63c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:21.620708 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-350e55b9-5bbc-4a99-aacb-58f2e4c8c63c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:21.622824 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-350e55b9-5bbc-4a99-aacb-58f2e4c8c63c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:21.623268 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-350e55b9-5bbc-4a99-aacb-58f2e4c8c63c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:22.031891 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-350e55b9-5bbc-4a99-aacb-58f2e4c8c63c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:41:22.039669 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-350e55b9-5bbc-4a99-aacb-58f2e4c8c63c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1751 microversion: 2.1 time: 0.433789 Nov 12 02:41:22.040234 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 704/1439] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:41:21 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1751 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:41:23.058092 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8f077efd-bef0-4ea1-98ef-1bfc318b8cf2 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:41:23.058817 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8f077efd-bef0-4ea1-98ef-1bfc318b8cf2 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:41:23.065289 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8f077efd-bef0-4ea1-98ef-1bfc318b8cf2 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:23.065743 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8f077efd-bef0-4ea1-98ef-1bfc318b8cf2 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:23.066524 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8f077efd-bef0-4ea1-98ef-1bfc318b8cf2 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:23.066996 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8f077efd-bef0-4ea1-98ef-1bfc318b8cf2 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:23.257694 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8f077efd-bef0-4ea1-98ef-1bfc318b8cf2 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:41:23.266107 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8f077efd-bef0-4ea1-98ef-1bfc318b8cf2 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1756 microversion: 2.1 time: 0.212538 Nov 12 02:41:23.266783 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 736/1440] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:41:23 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:41:24.283244 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-e91e051c-47c0-45de-8016-4c050e3e0dac tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:41:24.283813 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-e91e051c-47c0-45de-8016-4c050e3e0dac tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:41:24.290134 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e91e051c-47c0-45de-8016-4c050e3e0dac tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:24.290589 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e91e051c-47c0-45de-8016-4c050e3e0dac tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:24.291398 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e91e051c-47c0-45de-8016-4c050e3e0dac tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:24.291838 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-e91e051c-47c0-45de-8016-4c050e3e0dac tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:24.439724 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-e91e051c-47c0-45de-8016-4c050e3e0dac tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:41:24.447415 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-e91e051c-47c0-45de-8016-4c050e3e0dac tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1756 microversion: 2.1 time: 0.168025 Nov 12 02:41:24.447982 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 705/1441] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:41:24 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:41:25.464640 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2b22c9b6-9ae2-4d0b-a12e-ca3efda75b7a tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:41:25.465223 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2b22c9b6-9ae2-4d0b-a12e-ca3efda75b7a tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:41:25.472118 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2b22c9b6-9ae2-4d0b-a12e-ca3efda75b7a tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:25.472568 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2b22c9b6-9ae2-4d0b-a12e-ca3efda75b7a tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:25.473342 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2b22c9b6-9ae2-4d0b-a12e-ca3efda75b7a tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:25.473788 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2b22c9b6-9ae2-4d0b-a12e-ca3efda75b7a tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:25.623517 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-2b22c9b6-9ae2-4d0b-a12e-ca3efda75b7a tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:41:25.632195 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2b22c9b6-9ae2-4d0b-a12e-ca3efda75b7a tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1756 microversion: 2.1 time: 0.171388 Nov 12 02:41:25.632751 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 737/1442] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:41:25 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:41:26.649215 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6b347e0a-c30c-4012-a59d-ad80e1c9bf16 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:41:26.649901 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6b347e0a-c30c-4012-a59d-ad80e1c9bf16 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:41:26.656107 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6b347e0a-c30c-4012-a59d-ad80e1c9bf16 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:26.656549 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6b347e0a-c30c-4012-a59d-ad80e1c9bf16 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:26.657321 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6b347e0a-c30c-4012-a59d-ad80e1c9bf16 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:26.657754 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6b347e0a-c30c-4012-a59d-ad80e1c9bf16 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:26.809351 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6b347e0a-c30c-4012-a59d-ad80e1c9bf16 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:41:26.818458 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6b347e0a-c30c-4012-a59d-ad80e1c9bf16 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1756 microversion: 2.1 time: 0.172860 Nov 12 02:41:26.819054 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 706/1443] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:41:26 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:41:27.835763 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a519962c-c17a-47d9-a28e-b0421b69e25d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:41:27.836371 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a519962c-c17a-47d9-a28e-b0421b69e25d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:41:27.843120 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a519962c-c17a-47d9-a28e-b0421b69e25d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:27.843574 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a519962c-c17a-47d9-a28e-b0421b69e25d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:27.844347 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a519962c-c17a-47d9-a28e-b0421b69e25d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:27.844779 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a519962c-c17a-47d9-a28e-b0421b69e25d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:27.998562 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a519962c-c17a-47d9-a28e-b0421b69e25d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:41:28.006326 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a519962c-c17a-47d9-a28e-b0421b69e25d tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1756 microversion: 2.1 time: 0.174221 Nov 12 02:41:28.006933 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 738/1444] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:41:27 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:41:29.023740 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7c660afe-be09-475e-87bc-d9879f48f738 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:41:29.024431 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-7c660afe-be09-475e-87bc-d9879f48f738 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:41:29.030959 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c660afe-be09-475e-87bc-d9879f48f738 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:29.031404 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c660afe-be09-475e-87bc-d9879f48f738 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:29.032171 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c660afe-be09-475e-87bc-d9879f48f738 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:29.032603 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-7c660afe-be09-475e-87bc-d9879f48f738 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:29.174512 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-7c660afe-be09-475e-87bc-d9879f48f738 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:41:29.182111 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7c660afe-be09-475e-87bc-d9879f48f738 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1756 microversion: 2.1 time: 0.162094 Nov 12 02:41:29.182691 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 707/1445] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:41:29 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:41:30.200499 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-42fef76e-e1fa-4b68-b70f-fd81381f386c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:41:30.201109 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-42fef76e-e1fa-4b68-b70f-fd81381f386c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:41:30.208071 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42fef76e-e1fa-4b68-b70f-fd81381f386c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:30.208518 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42fef76e-e1fa-4b68-b70f-fd81381f386c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:30.209284 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42fef76e-e1fa-4b68-b70f-fd81381f386c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:30.209717 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42fef76e-e1fa-4b68-b70f-fd81381f386c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:30.351834 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-42fef76e-e1fa-4b68-b70f-fd81381f386c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:41:30.360118 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-42fef76e-e1fa-4b68-b70f-fd81381f386c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1756 microversion: 2.1 time: 0.163346 Nov 12 02:41:30.360683 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 739/1446] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:41:30 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:41:31.377136 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a81cfaf2-487c-4b1d-aea2-aaef880cb3e0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:41:31.377746 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a81cfaf2-487c-4b1d-aea2-aaef880cb3e0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:41:31.384110 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a81cfaf2-487c-4b1d-aea2-aaef880cb3e0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:31.384561 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a81cfaf2-487c-4b1d-aea2-aaef880cb3e0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:31.385341 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a81cfaf2-487c-4b1d-aea2-aaef880cb3e0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:31.385777 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a81cfaf2-487c-4b1d-aea2-aaef880cb3e0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:31.535538 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a81cfaf2-487c-4b1d-aea2-aaef880cb3e0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:41:31.543227 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a81cfaf2-487c-4b1d-aea2-aaef880cb3e0 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1756 microversion: 2.1 time: 0.169821 Nov 12 02:41:31.543793 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 708/1447] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:41:31 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:41:32.560252 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1a4f435e-3ca6-44d2-9a2b-65e2d83903be tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:41:32.560896 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1a4f435e-3ca6-44d2-9a2b-65e2d83903be tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:41:32.567768 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a4f435e-3ca6-44d2-9a2b-65e2d83903be tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:32.568207 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a4f435e-3ca6-44d2-9a2b-65e2d83903be tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:32.568967 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a4f435e-3ca6-44d2-9a2b-65e2d83903be tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:32.569396 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1a4f435e-3ca6-44d2-9a2b-65e2d83903be tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:32.714609 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1a4f435e-3ca6-44d2-9a2b-65e2d83903be tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:41:32.723195 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1a4f435e-3ca6-44d2-9a2b-65e2d83903be tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1756 microversion: 2.1 time: 0.166762 Nov 12 02:41:32.723769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 740/1448] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:41:32 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:41:33.740267 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-1293b21c-293b-4e8d-a424-bef3bdae5598 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:41:33.740908 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-1293b21c-293b-4e8d-a424-bef3bdae5598 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:41:33.747439 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1293b21c-293b-4e8d-a424-bef3bdae5598 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:33.747888 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1293b21c-293b-4e8d-a424-bef3bdae5598 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:33.748695 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1293b21c-293b-4e8d-a424-bef3bdae5598 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:41:33.749102 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-1293b21c-293b-4e8d-a424-bef3bdae5598 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:41:33.901098 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-1293b21c-293b-4e8d-a424-bef3bdae5598 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:41:33.909479 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-1293b21c-293b-4e8d-a424-bef3bdae5598 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1759 microversion: 2.1 time: 0.172923 Nov 12 02:41:33.910046 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 709/1449] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:41:33 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:42:37.313989 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-0bdcdaec-7e17-4cd3-9722-5eee1b638241 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-954143246"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:42:37.314607 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-0bdcdaec-7e17-4cd3-9722-5eee1b638241 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:42:37.320621 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0bdcdaec-7e17-4cd3-9722-5eee1b638241 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:37.321068 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0bdcdaec-7e17-4cd3-9722-5eee1b638241 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:37.321871 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0bdcdaec-7e17-4cd3-9722-5eee1b638241 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:37.322300 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-0bdcdaec-7e17-4cd3-9722-5eee1b638241 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:37.466352 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.network.security_group_api [None req-0bdcdaec-7e17-4cd3-9722-5eee1b638241 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Removing security group b1e31fb8-6a09-4bfb-aea9-2d1a1cfd7556 from port 38e80ebc-90b9-4664-a8b5-b860fd8e892f Nov 12 02:42:37.831066 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-0bdcdaec-7e17-4cd3-9722-5eee1b638241 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "POST /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/action" status: 202 len: 0 microversion: 2.1 time: 0.522199 Nov 12 02:42:37.836741 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 741/1450] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:42:37 2021] POST /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:42:37.937065 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-f2d88826-9f5d-46f4-9bdb-03842e09fec0 req-702f3c03-a38f-468b-93a3-5b9ef26d91e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc0df28-0c70-4056-8f47-74774e043cba", "tag": "38e80ebc-90b9-4664-a8b5-b860fd8e892f"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:42:37.940384 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:42:37.940384 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:42:37.953610 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-f2d88826-9f5d-46f4-9bdb-03842e09fec0 req-702f3c03-a38f-468b-93a3-5b9ef26d91e3 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:37.954582 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-f2d88826-9f5d-46f4-9bdb-03842e09fec0 req-702f3c03-a38f-468b-93a3-5b9ef26d91e3 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:37.978053 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-f2d88826-9f5d-46f4-9bdb-03842e09fec0 req-702f3c03-a38f-468b-93a3-5b9ef26d91e3 service nova] Creating event network-changed:38e80ebc-90b9-4664-a8b5-b860fd8e892f for instance bdc0df28-0c70-4056-8f47-74774e043cba on hv-cinder-80857 Nov 12 02:42:37.989178 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-f2d88826-9f5d-46f4-9bdb-03842e09fec0 req-702f3c03-a38f-468b-93a3-5b9ef26d91e3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148347 Nov 12 02:42:37.990357 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 710/1451] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:42:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:42:39.080889 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-cf2cf50c-00de-45d2-9428-cdf2e3a94f77 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:42:39.081752 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-cf2cf50c-00de-45d2-9428-cdf2e3a94f77 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:42:39.082514 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-3c9dd129-2fec-4478-9497-d5b932a46a65 req-85e23fb3-4b56-4398-a7e1-3ddf676a7aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdc0df28-0c70-4056-8f47-74774e043cba", "tag": "38e80ebc-90b9-4664-a8b5-b860fd8e892f"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:42:39.084143 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:42:39.084143 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:42:39.092053 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cf2cf50c-00de-45d2-9428-cdf2e3a94f77 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:39.092917 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cf2cf50c-00de-45d2-9428-cdf2e3a94f77 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:39.095240 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cf2cf50c-00de-45d2-9428-cdf2e3a94f77 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:39.096527 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-3c9dd129-2fec-4478-9497-d5b932a46a65 req-85e23fb3-4b56-4398-a7e1-3ddf676a7aa8 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:39.096931 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cf2cf50c-00de-45d2-9428-cdf2e3a94f77 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:39.097595 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-3c9dd129-2fec-4478-9497-d5b932a46a65 req-85e23fb3-4b56-4398-a7e1-3ddf676a7aa8 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:39.118328 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-3c9dd129-2fec-4478-9497-d5b932a46a65 req-85e23fb3-4b56-4398-a7e1-3ddf676a7aa8 service nova] Creating event network-changed:38e80ebc-90b9-4664-a8b5-b860fd8e892f for instance bdc0df28-0c70-4056-8f47-74774e043cba on hv-cinder-80857 Nov 12 02:42:39.126279 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-3c9dd129-2fec-4478-9497-d5b932a46a65 req-85e23fb3-4b56-4398-a7e1-3ddf676a7aa8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048051 Nov 12 02:42:39.127761 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 711/1452] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:42:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:42:39.198868 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.objects.instance [None req-cf2cf50c-00de-45d2-9428-cdf2e3a94f77 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lazy-loading 'services' on Instance uuid bdc0df28-0c70-4056-8f47-74774e043cba {{(pid=116099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:42:39.289533 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-cf2cf50c-00de-45d2-9428-cdf2e3a94f77 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/os-volume_attachments/696ae3c2-a42f-41a0-a76d-ca3b17847f7d" status: 202 len: 0 microversion: 2.1 time: 0.212884 Nov 12 02:42:39.294277 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 742/1453] 10.222.0.70 () {58 vars in 1415 bytes} [Fri Nov 12 02:42:39 2021] DELETE /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/os-volume_attachments/696ae3c2-a42f-41a0-a76d-ca3b17847f7d => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:42:39.300224 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a55f33b1-b4da-463e-83b5-373e2f986b02 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:42:39.301226 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a55f33b1-b4da-463e-83b5-373e2f986b02 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:42:39.308347 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a55f33b1-b4da-463e-83b5-373e2f986b02 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:39.308785 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a55f33b1-b4da-463e-83b5-373e2f986b02 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:39.310295 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a55f33b1-b4da-463e-83b5-373e2f986b02 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:39.310925 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a55f33b1-b4da-463e-83b5-373e2f986b02 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:39.341440 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a55f33b1-b4da-463e-83b5-373e2f986b02 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 Nov 12 02:42:39.342385 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 712/1454] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:42:39 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:42:40.355087 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-89527806-e4e3-4f8b-8093-68148a2019c7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:42:40.356540 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-89527806-e4e3-4f8b-8093-68148a2019c7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:42:40.363123 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-89527806-e4e3-4f8b-8093-68148a2019c7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:40.363563 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-89527806-e4e3-4f8b-8093-68148a2019c7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:40.364334 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-89527806-e4e3-4f8b-8093-68148a2019c7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:40.364760 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-89527806-e4e3-4f8b-8093-68148a2019c7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:40.396496 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-89527806-e4e3-4f8b-8093-68148a2019c7 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045878 Nov 12 02:42:40.397057 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 743/1455] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:42:40 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 12 02:42:41.408070 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0d42fb70-cfe7-43db-901a-4098e10932ae tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:42:41.408914 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0d42fb70-cfe7-43db-901a-4098e10932ae tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:42:41.415148 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0d42fb70-cfe7-43db-901a-4098e10932ae tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:41.415593 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0d42fb70-cfe7-43db-901a-4098e10932ae tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:41.416369 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0d42fb70-cfe7-43db-901a-4098e10932ae tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:41.416802 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0d42fb70-cfe7-43db-901a-4098e10932ae tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:41.444875 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0d42fb70-cfe7-43db-901a-4098e10932ae tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040588 Nov 12 02:42:41.445445 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 713/1456] 10.222.0.70 () {58 vars in 1301 bytes} [Fri Nov 12 02:42:41 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 12 02:42:41.455820 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-197c9f99-980a-4bfb-b4be-357a89d6e35c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:42:41.456418 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-197c9f99-980a-4bfb-b4be-357a89d6e35c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:42:41.463038 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-197c9f99-980a-4bfb-b4be-357a89d6e35c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:41.463457 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-197c9f99-980a-4bfb-b4be-357a89d6e35c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:41.464223 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-197c9f99-980a-4bfb-b4be-357a89d6e35c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:41.464652 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-197c9f99-980a-4bfb-b4be-357a89d6e35c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:41.536328 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-197c9f99-980a-4bfb-b4be-357a89d6e35c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] HTTP exception thrown: Instance bdc0df28-0c70-4056-8f47-74774e043cba is not attached to volume 696ae3c2-a42f-41a0-a76d-ca3b17847f7d Nov 12 02:42:41.536971 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-197c9f99-980a-4bfb-b4be-357a89d6e35c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Returning 404 to user: Instance bdc0df28-0c70-4056-8f47-74774e043cba is not attached to volume 696ae3c2-a42f-41a0-a76d-ca3b17847f7d {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:42:41.537863 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-197c9f99-980a-4bfb-b4be-357a89d6e35c tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/os-volume_attachments/696ae3c2-a42f-41a0-a76d-ca3b17847f7d" status: 404 len: 154 microversion: 2.1 time: 0.085940 Nov 12 02:42:41.538474 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 744/1457] 10.222.0.70 () {58 vars in 1415 bytes} [Fri Nov 12 02:42:41 2021] DELETE /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba/os-volume_attachments/696ae3c2-a42f-41a0-a76d-ca3b17847f7d => generated 154 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 12 02:42:42.690495 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-673adb2f-eecf-4c60-bea6-6342498d4fea tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:42:42.691173 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-673adb2f-eecf-4c60-bea6-6342498d4fea tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:42:42.698119 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-673adb2f-eecf-4c60-bea6-6342498d4fea tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:42.698561 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-673adb2f-eecf-4c60-bea6-6342498d4fea tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:42.699405 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-673adb2f-eecf-4c60-bea6-6342498d4fea tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:42.700499 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-673adb2f-eecf-4c60-bea6-6342498d4fea tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:42.724971 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-673adb2f-eecf-4c60-bea6-6342498d4fea tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:42:42.798357 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-673adb2f-eecf-4c60-bea6-6342498d4fea tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 204 len: 0 microversion: 2.1 time: 0.111546 Nov 12 02:42:42.802733 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 714/1458] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:42:42 2021] DELETE /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:42:42.809981 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-1e962593-e21e-4a0c-9424-5ef568d0e2df tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:42:42.810595 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-1e962593-e21e-4a0c-9424-5ef568d0e2df tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:42:42.817000 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1e962593-e21e-4a0c-9424-5ef568d0e2df tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:42.817441 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1e962593-e21e-4a0c-9424-5ef568d0e2df tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:42.818215 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1e962593-e21e-4a0c-9424-5ef568d0e2df tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:42.818645 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-1e962593-e21e-4a0c-9424-5ef568d0e2df tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:42.953806 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-1e962593-e21e-4a0c-9424-5ef568d0e2df tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:42:42.961240 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-1e962593-e21e-4a0c-9424-5ef568d0e2df tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1555 microversion: 2.1 time: 0.157088 Nov 12 02:42:42.961816 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 745/1459] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:42:42 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:42:43.978591 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-77138c19-be6e-4715-872d-414ba2e807ce tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:42:43.979236 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-77138c19-be6e-4715-872d-414ba2e807ce tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:42:43.985986 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-77138c19-be6e-4715-872d-414ba2e807ce tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:43.986431 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-77138c19-be6e-4715-872d-414ba2e807ce tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:43.987252 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-77138c19-be6e-4715-872d-414ba2e807ce tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:43.987714 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-77138c19-be6e-4715-872d-414ba2e807ce tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:44.127893 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-77138c19-be6e-4715-872d-414ba2e807ce tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:42:44.135263 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-77138c19-be6e-4715-872d-414ba2e807ce tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1555 microversion: 2.1 time: 0.160781 Nov 12 02:42:44.135831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 715/1460] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:42:43 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:42:45.155636 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c920c454-183e-4584-b1a6-4224c54ea636 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:42:45.156673 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c920c454-183e-4584-b1a6-4224c54ea636 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:42:45.164747 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c920c454-183e-4584-b1a6-4224c54ea636 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:45.165296 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c920c454-183e-4584-b1a6-4224c54ea636 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:45.166171 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c920c454-183e-4584-b1a6-4224c54ea636 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:45.166613 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c920c454-183e-4584-b1a6-4224c54ea636 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:45.380435 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c920c454-183e-4584-b1a6-4224c54ea636 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3831cdcdfd4cbbb736e88317c0eaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c863d2b5a6444d01a46426976b87632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:42:45.388645 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c920c454-183e-4584-b1a6-4224c54ea636 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 200 len: 1555 microversion: 2.1 time: 0.239535 Nov 12 02:42:45.389231 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 746/1461] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:42:45 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 1555 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:42:45.542926 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-a5edee64-8592-4712-b189-9b6f88e367fb req-6dc7e034-8794-4da0-be51-6d507c3cb9ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdc0df28-0c70-4056-8f47-74774e043cba", "name": "network-vif-deleted", "tag": "38e80ebc-90b9-4664-a8b5-b860fd8e892f"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:42:45.545400 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:42:45.545400 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:42:45.553160 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-a5edee64-8592-4712-b189-9b6f88e367fb req-6dc7e034-8794-4da0-be51-6d507c3cb9ef service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:45.553600 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-a5edee64-8592-4712-b189-9b6f88e367fb req-6dc7e034-8794-4da0-be51-6d507c3cb9ef service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:45.566373 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-a5edee64-8592-4712-b189-9b6f88e367fb req-6dc7e034-8794-4da0-be51-6d507c3cb9ef service nova] Creating event network-vif-deleted:38e80ebc-90b9-4664-a8b5-b860fd8e892f for instance bdc0df28-0c70-4056-8f47-74774e043cba on hv-cinder-80857 Nov 12 02:42:45.571314 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-a5edee64-8592-4712-b189-9b6f88e367fb req-6dc7e034-8794-4da0-be51-6d507c3cb9ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032036 Nov 12 02:42:45.571916 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 716/1462] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:42:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:42:46.410655 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-625c682b-a587-479b-aaf4-364872bdc1da tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:42:46.411457 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-625c682b-a587-479b-aaf4-364872bdc1da tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [instance: bdc0df28-0c70-4056-8f47-74774e043cba] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:42:46.421985 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-625c682b-a587-479b-aaf4-364872bdc1da tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:46.422722 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-625c682b-a587-479b-aaf4-364872bdc1da tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:46.423881 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-625c682b-a587-479b-aaf4-364872bdc1da tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:42:46.424531 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-625c682b-a587-479b-aaf4-364872bdc1da tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:42:46.440140 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-625c682b-a587-479b-aaf4-364872bdc1da tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] HTTP exception thrown: Instance bdc0df28-0c70-4056-8f47-74774e043cba could not be found. Nov 12 02:42:46.440731 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-625c682b-a587-479b-aaf4-364872bdc1da tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Returning 404 to user: Instance bdc0df28-0c70-4056-8f47-74774e043cba could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:42:46.441564 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-625c682b-a587-479b-aaf4-364872bdc1da tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba" status: 404 len: 111 microversion: 2.1 time: 0.038600 Nov 12 02:42:46.442110 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 747/1463] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:42:46 2021] GET /compute/v2.1/servers/bdc0df28-0c70-4056-8f47-74774e043cba => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 12 02:42:46.451788 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-7f9f767f-63a0-46ed-b4e8-665f38d30781 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] Calling method '.version_select at 0x7fc0646ebca0>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:42:46.454974 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7f9f767f-63a0-46ed-b4e8-665f38d30781 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [bac116eb-8914-4133-87f0-0368da502240] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 12 02:42:47.471234 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [None req-7f9f767f-63a0-46ed-b4e8-665f38d30781 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] [bac116eb-8914-4133-87f0-0368da502240] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 47464. Nov 12 02:42:47.490283 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-7f9f767f-63a0-46ed-b4e8-665f38d30781 tempest-TestMinimumBasicScenario-1829549236 tempest-TestMinimumBasicScenario-1829549236-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1890216270" status: 202 len: 0 microversion: 2.1 time: 1.042648 Nov 12 02:42:47.490907 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 717/1464] 10.222.0.70 () {58 vars in 1271 bytes} [Fri Nov 12 02:42:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1890216270 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:42:53.669278 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:42:53.669934 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: Fri Nov 12 02:42:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:42:54.457312 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:42:54.457882 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: Fri Nov 12 02:42:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:43:05.771360 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-731c192f-229c-4ef0-8946-4978c49e6e06 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Action: 'create', calling method: .version_select at 0x7fc06479fe50>, body: {"keypair": {"name": "tempest-TestShelveInstance-501889527"}} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:43:05.785293 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-731c192f-229c-4ef0-8946-4978c49e6e06 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Getting quotas for project 0d6994b5f4e24d6483ad3e16b25cf629. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:43:05.789070 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-731c192f-229c-4ef0-8946-4978c49e6e06 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Getting quotas for user 8c56e75d27c448fc9be9ccc0d0f5efd1 and project 0d6994b5f4e24d6483ad3e16b25cf629. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:43:06.009236 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-731c192f-229c-4ef0-8946-4978c49e6e06 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Getting quotas for project 0d6994b5f4e24d6483ad3e16b25cf629. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:43:06.012954 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.quota [None req-731c192f-229c-4ef0-8946-4978c49e6e06 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Getting quotas for user 8c56e75d27c448fc9be9ccc0d0f5efd1 and project 0d6994b5f4e24d6483ad3e16b25cf629. Resources: {'key_pairs'} {{(pid=116099) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:43:06.026175 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-731c192f-229c-4ef0-8946-4978c49e6e06 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.415754 Nov 12 02:43:06.027486 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 748/1465] 10.222.0.70 () {60 vars in 1157 bytes} [Fri Nov 12 02:43:05 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:30.518179 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-627492182", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-501889527", "security_groups": [{"name": "tempest-secgroup-smoke-1461261139"}], "networks": [{"uuid": "425b490a-d6f0-477e-9438-9d9ddb46ede3"}], "block_device_mapping_v2": [{"uuid": "278df783-433b-4395-aa09-a8cbbc8a63dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:43:30.627641 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.network.neutron [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] validate_networks() for [('425b490a-d6f0-477e-9438-9d9ddb46ede3', None, None, None, None, None)] {{(pid=116098) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 12 02:43:31.103487 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Flavor limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 12 02:43:31.103896 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Image limits 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 12 02:43:31.104533 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Flavor pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 12 02:43:31.105452 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Image pref 0:0:0 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 12 02:43:31.105935 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.virt.hardware [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 12 02:43:31.114321 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:31.115068 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:31.116495 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:31.117403 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:31.138289 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Getting quotas for project 0d6994b5f4e24d6483ad3e16b25cf629. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 12 02:43:31.142501 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.quota [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Getting quotas for user 8c56e75d27c448fc9be9ccc0d0f5efd1 and project 0d6994b5f4e24d6483ad3e16b25cf629. Resources: {'instances', 'cores', 'ram'} {{(pid=116098) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 12 02:43:31.198089 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Going to run 1 instances... {{(pid=116098) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 12 02:43:31.200481 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='278df783-433b-4395-aa09-a8cbbc8a63dd',volume_size=None,volume_type=None)] {{(pid=116098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 12 02:43:31.322353 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0efbc2f8-062a-4a36-8f66-f8b6e830342b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.808238 Nov 12 02:43:31.323108 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 718/1466] 10.222.0.70 () {60 vars in 1146 bytes} [Fri Nov 12 02:43:30 2021] POST /compute/v2.1/servers => generated 406 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 12 02:43:31.333540 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-bd0454fb-a852-47ba-b8e1-17b69f24230a tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:31.334157 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-bd0454fb-a852-47ba-b8e1-17b69f24230a tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:31.388078 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-bd0454fb-a852-47ba-b8e1-17b69f24230a tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:31.394566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-bd0454fb-a852-47ba-b8e1-17b69f24230a tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1087 microversion: 2.1 time: 0.065188 Nov 12 02:43:31.395169 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 749/1467] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:31 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1087 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:32.411957 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-ca2d5d05-111d-41a0-8309-f5764c62f00c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:32.412514 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-ca2d5d05-111d-41a0-8309-f5764c62f00c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:32.419241 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca2d5d05-111d-41a0-8309-f5764c62f00c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:32.419690 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca2d5d05-111d-41a0-8309-f5764c62f00c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:32.420460 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca2d5d05-111d-41a0-8309-f5764c62f00c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:32.420890 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-ca2d5d05-111d-41a0-8309-f5764c62f00c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:32.479926 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-ca2d5d05-111d-41a0-8309-f5764c62f00c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:32.487384 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-ca2d5d05-111d-41a0-8309-f5764c62f00c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1185 microversion: 2.1 time: 0.079648 Nov 12 02:43:32.487950 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 719/1468] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:32 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:33.505214 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-2967b77f-eec5-43cc-a522-f25be1e156f7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:33.505827 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-2967b77f-eec5-43cc-a522-f25be1e156f7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:33.513636 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2967b77f-eec5-43cc-a522-f25be1e156f7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:33.514091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2967b77f-eec5-43cc-a522-f25be1e156f7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:33.514928 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2967b77f-eec5-43cc-a522-f25be1e156f7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:33.515371 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-2967b77f-eec5-43cc-a522-f25be1e156f7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:33.759391 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-2967b77f-eec5-43cc-a522-f25be1e156f7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:33.767511 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-2967b77f-eec5-43cc-a522-f25be1e156f7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1259 microversion: 2.1 time: 0.265933 Nov 12 02:43:33.768179 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 750/1469] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:33 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1259 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:34.109484 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-cfd742a1-3c64-4311-baa2-8e179ebae69d req-f901a996-bc76-4f98-a674-c9d627a54cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da7e9d31-7e6e-419c-8dbe-389d6b7bc47d", "tag": "7fb54192-d715-4357-a504-8563617dad4b"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:43:34.111145 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:43:34.111145 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:43:34.124018 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-cfd742a1-3c64-4311-baa2-8e179ebae69d req-f901a996-bc76-4f98-a674-c9d627a54cd6 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:34.124758 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-cfd742a1-3c64-4311-baa2-8e179ebae69d req-f901a996-bc76-4f98-a674-c9d627a54cd6 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:34.142892 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-cfd742a1-3c64-4311-baa2-8e179ebae69d req-f901a996-bc76-4f98-a674-c9d627a54cd6 service nova] Creating event network-changed:7fb54192-d715-4357-a504-8563617dad4b for instance da7e9d31-7e6e-419c-8dbe-389d6b7bc47d on hv-cinder-80857 Nov 12 02:43:34.148450 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-cfd742a1-3c64-4311-baa2-8e179ebae69d req-f901a996-bc76-4f98-a674-c9d627a54cd6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043775 Nov 12 02:43:34.149608 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 720/1470] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:43:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:43:34.784585 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-40bf0f2b-1475-4541-a23a-9816d710be37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:34.785185 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-40bf0f2b-1475-4541-a23a-9816d710be37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:34.791732 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-40bf0f2b-1475-4541-a23a-9816d710be37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:34.792185 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-40bf0f2b-1475-4541-a23a-9816d710be37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:34.793015 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-40bf0f2b-1475-4541-a23a-9816d710be37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:34.793454 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-40bf0f2b-1475-4541-a23a-9816d710be37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:35.024351 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-40bf0f2b-1475-4541-a23a-9816d710be37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:35.032566 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-40bf0f2b-1475-4541-a23a-9816d710be37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1259 microversion: 2.1 time: 0.251595 Nov 12 02:43:35.033166 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 751/1471] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:34 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:36.051153 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-d2da3f32-ee76-47e5-9693-f41395796dee tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:36.051879 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-d2da3f32-ee76-47e5-9693-f41395796dee tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:36.059901 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2da3f32-ee76-47e5-9693-f41395796dee tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:36.060594 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2da3f32-ee76-47e5-9693-f41395796dee tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:36.061784 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2da3f32-ee76-47e5-9693-f41395796dee tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:36.062228 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-d2da3f32-ee76-47e5-9693-f41395796dee tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:36.216693 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-d2da3f32-ee76-47e5-9693-f41395796dee tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:36.224035 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-d2da3f32-ee76-47e5-9693-f41395796dee tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1259 microversion: 2.1 time: 0.177477 Nov 12 02:43:36.224609 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 721/1472] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:36 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:37.243039 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-12940c81-5fae-4c46-ae38-1778f150c4aa tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:37.243928 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-12940c81-5fae-4c46-ae38-1778f150c4aa tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:37.249776 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12940c81-5fae-4c46-ae38-1778f150c4aa tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:37.250227 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12940c81-5fae-4c46-ae38-1778f150c4aa tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:37.251028 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12940c81-5fae-4c46-ae38-1778f150c4aa tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:37.251467 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-12940c81-5fae-4c46-ae38-1778f150c4aa tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:37.381714 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-12940c81-5fae-4c46-ae38-1778f150c4aa tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:37.394826 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-12940c81-5fae-4c46-ae38-1778f150c4aa tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1259 microversion: 2.1 time: 0.155556 Nov 12 02:43:37.395403 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 752/1473] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:37 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:38.411629 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-11b9dc3a-4a9a-49a6-9321-d1d571c134e9 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:38.412164 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-11b9dc3a-4a9a-49a6-9321-d1d571c134e9 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:38.419293 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11b9dc3a-4a9a-49a6-9321-d1d571c134e9 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:38.419740 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11b9dc3a-4a9a-49a6-9321-d1d571c134e9 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:38.420629 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11b9dc3a-4a9a-49a6-9321-d1d571c134e9 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:38.421062 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-11b9dc3a-4a9a-49a6-9321-d1d571c134e9 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:38.564499 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-11b9dc3a-4a9a-49a6-9321-d1d571c134e9 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:38.571844 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-11b9dc3a-4a9a-49a6-9321-d1d571c134e9 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1259 microversion: 2.1 time: 0.163969 Nov 12 02:43:38.572451 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 722/1474] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:38 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:39.588834 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-8d05ad21-ed0f-4af6-9e3f-f39440c6ce1a tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:39.589374 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-8d05ad21-ed0f-4af6-9e3f-f39440c6ce1a tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:39.595727 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d05ad21-ed0f-4af6-9e3f-f39440c6ce1a tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:39.596173 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d05ad21-ed0f-4af6-9e3f-f39440c6ce1a tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:39.596941 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d05ad21-ed0f-4af6-9e3f-f39440c6ce1a tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:39.597389 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-8d05ad21-ed0f-4af6-9e3f-f39440c6ce1a tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:39.729698 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-8d05ad21-ed0f-4af6-9e3f-f39440c6ce1a tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:39.738159 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-8d05ad21-ed0f-4af6-9e3f-f39440c6ce1a tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1259 microversion: 2.1 time: 0.153303 Nov 12 02:43:39.738823 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 753/1475] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:39 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:40.755371 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-46a3d1ed-2329-4505-b318-568a7dcfd5c2 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:40.755965 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-46a3d1ed-2329-4505-b318-568a7dcfd5c2 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:40.762933 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46a3d1ed-2329-4505-b318-568a7dcfd5c2 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:40.763383 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46a3d1ed-2329-4505-b318-568a7dcfd5c2 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:40.764172 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46a3d1ed-2329-4505-b318-568a7dcfd5c2 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:40.764606 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-46a3d1ed-2329-4505-b318-568a7dcfd5c2 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:40.899635 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-46a3d1ed-2329-4505-b318-568a7dcfd5c2 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:40.907563 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-46a3d1ed-2329-4505-b318-568a7dcfd5c2 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1259 microversion: 2.1 time: 0.155849 Nov 12 02:43:40.908127 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 723/1476] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:40 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:41.925008 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4d4ac3fc-3327-4151-b361-632ddca6854c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:41.925705 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4d4ac3fc-3327-4151-b361-632ddca6854c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:41.932810 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4d4ac3fc-3327-4151-b361-632ddca6854c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:41.933255 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4d4ac3fc-3327-4151-b361-632ddca6854c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:41.934012 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4d4ac3fc-3327-4151-b361-632ddca6854c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:41.934439 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4d4ac3fc-3327-4151-b361-632ddca6854c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:42.068063 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4d4ac3fc-3327-4151-b361-632ddca6854c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:42.075914 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4d4ac3fc-3327-4151-b361-632ddca6854c tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1259 microversion: 2.1 time: 0.155104 Nov 12 02:43:42.076473 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 754/1477] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:41 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:43.093217 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-515118cf-4bc1-4eea-bf4a-1b759f71b96b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:43.093888 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-515118cf-4bc1-4eea-bf4a-1b759f71b96b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:43.100536 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-515118cf-4bc1-4eea-bf4a-1b759f71b96b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:43.100983 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-515118cf-4bc1-4eea-bf4a-1b759f71b96b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:43.101758 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-515118cf-4bc1-4eea-bf4a-1b759f71b96b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:43.102185 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-515118cf-4bc1-4eea-bf4a-1b759f71b96b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:43.245867 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-515118cf-4bc1-4eea-bf4a-1b759f71b96b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:43.253916 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-515118cf-4bc1-4eea-bf4a-1b759f71b96b tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1259 microversion: 2.1 time: 0.165035 Nov 12 02:43:43.254480 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 724/1478] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:43 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:44.269725 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-110bead3-4b49-4c85-ab19-cda1775e41b4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:44.270315 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-110bead3-4b49-4c85-ab19-cda1775e41b4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:44.276620 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-110bead3-4b49-4c85-ab19-cda1775e41b4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:44.277073 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-110bead3-4b49-4c85-ab19-cda1775e41b4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:44.277839 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-110bead3-4b49-4c85-ab19-cda1775e41b4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:44.278269 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-110bead3-4b49-4c85-ab19-cda1775e41b4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:44.421463 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-110bead3-4b49-4c85-ab19-cda1775e41b4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:44.429699 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-110bead3-4b49-4c85-ab19-cda1775e41b4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1259 microversion: 2.1 time: 0.163655 Nov 12 02:43:44.430311 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 755/1479] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:44 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:45.124501 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-a8089a55-9841-4129-810b-b450f0561b02 req-6287e942-7b4e-40d2-8830-fc3edbcfd7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7e9d31-7e6e-419c-8dbe-389d6b7bc47d", "name": "network-vif-plugged", "status": "completed", "tag": "7fb54192-d715-4357-a504-8563617dad4b"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:43:45.126070 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:43:45.126070 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:43:45.134745 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-a8089a55-9841-4129-810b-b450f0561b02 req-6287e942-7b4e-40d2-8830-fc3edbcfd7a8 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:45.135236 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-a8089a55-9841-4129-810b-b450f0561b02 req-6287e942-7b4e-40d2-8830-fc3edbcfd7a8 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:45.146999 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-a8089a55-9841-4129-810b-b450f0561b02 req-6287e942-7b4e-40d2-8830-fc3edbcfd7a8 service nova] Creating event network-vif-plugged:7fb54192-d715-4357-a504-8563617dad4b for instance da7e9d31-7e6e-419c-8dbe-389d6b7bc47d on hv-cinder-80857 Nov 12 02:43:45.152177 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-a8089a55-9841-4129-810b-b450f0561b02 req-6287e942-7b4e-40d2-8830-fc3edbcfd7a8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031340 Nov 12 02:43:45.153477 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 725/1480] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:43:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:43:45.448848 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-79409f20-708e-4991-a530-3e1a35205c70 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:45.449547 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-79409f20-708e-4991-a530-3e1a35205c70 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:45.455903 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-79409f20-708e-4991-a530-3e1a35205c70 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:45.456356 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-79409f20-708e-4991-a530-3e1a35205c70 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:45.457137 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-79409f20-708e-4991-a530-3e1a35205c70 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:45.457574 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-79409f20-708e-4991-a530-3e1a35205c70 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:45.606043 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-79409f20-708e-4991-a530-3e1a35205c70 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:45.613259 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-79409f20-708e-4991-a530-3e1a35205c70 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1259 microversion: 2.1 time: 0.168094 Nov 12 02:43:45.613821 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 756/1481] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:45 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:46.631907 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-39ea0c49-5c90-459f-a460-29f8e8718b96 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:46.632617 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-39ea0c49-5c90-459f-a460-29f8e8718b96 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:46.639736 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-39ea0c49-5c90-459f-a460-29f8e8718b96 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:46.640197 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-39ea0c49-5c90-459f-a460-29f8e8718b96 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:46.640962 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-39ea0c49-5c90-459f-a460-29f8e8718b96 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:46.641389 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-39ea0c49-5c90-459f-a460-29f8e8718b96 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:46.778439 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-39ea0c49-5c90-459f-a460-29f8e8718b96 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:46.791565 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-39ea0c49-5c90-459f-a460-29f8e8718b96 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1259 microversion: 2.1 time: 0.164341 Nov 12 02:43:46.792403 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 726/1482] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:46 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:47.809366 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-321d6c24-21b2-461c-823d-f334ed07fe10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:47.809996 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-321d6c24-21b2-461c-823d-f334ed07fe10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:47.816996 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-321d6c24-21b2-461c-823d-f334ed07fe10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:47.817451 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-321d6c24-21b2-461c-823d-f334ed07fe10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:47.818236 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-321d6c24-21b2-461c-823d-f334ed07fe10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:47.818690 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-321d6c24-21b2-461c-823d-f334ed07fe10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:47.949331 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-321d6c24-21b2-461c-823d-f334ed07fe10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:47.956779 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-321d6c24-21b2-461c-823d-f334ed07fe10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1444 microversion: 2.1 time: 0.151754 Nov 12 02:43:47.957354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 757/1483] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:47 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1444 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:47.972902 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-aef14f52-ed62-4dd6-a550-1fd2c24d7b2e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:43:47.973496 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-aef14f52-ed62-4dd6-a550-1fd2c24d7b2e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:43:47.979743 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aef14f52-ed62-4dd6-a550-1fd2c24d7b2e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:47.980199 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aef14f52-ed62-4dd6-a550-1fd2c24d7b2e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:47.981540 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aef14f52-ed62-4dd6-a550-1fd2c24d7b2e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:47.981971 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-aef14f52-ed62-4dd6-a550-1fd2c24d7b2e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:48.115593 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-aef14f52-ed62-4dd6-a550-1fd2c24d7b2e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:43:48.123042 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-aef14f52-ed62-4dd6-a550-1fd2c24d7b2e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1444 microversion: 2.1 time: 0.153724 Nov 12 02:43:48.123609 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 727/1484] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:43:47 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:43:49.862599 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-cf1e4d33-7303-4102-9e5f-1936dd5b3013 req-c81c61a5-4084-4952-8e2f-f9fbe7917ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da7e9d31-7e6e-419c-8dbe-389d6b7bc47d", "tag": "7fb54192-d715-4357-a504-8563617dad4b"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:43:49.864862 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:43:49.864862 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:43:49.873575 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-cf1e4d33-7303-4102-9e5f-1936dd5b3013 req-c81c61a5-4084-4952-8e2f-f9fbe7917ed9 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:43:49.874090 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-cf1e4d33-7303-4102-9e5f-1936dd5b3013 req-c81c61a5-4084-4952-8e2f-f9fbe7917ed9 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:43:49.887274 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-cf1e4d33-7303-4102-9e5f-1936dd5b3013 req-c81c61a5-4084-4952-8e2f-f9fbe7917ed9 service nova] Creating event network-changed:7fb54192-d715-4357-a504-8563617dad4b for instance da7e9d31-7e6e-419c-8dbe-389d6b7bc47d on hv-cinder-80857 Nov 12 02:43:49.893088 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-cf1e4d33-7303-4102-9e5f-1936dd5b3013 req-c81c61a5-4084-4952-8e2f-f9fbe7917ed9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092471 Nov 12 02:43:49.893840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 758/1485] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:43:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:46:05.833719 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-beb0688e-f4fc-43f8-95a4-18d875e49a4d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:46:05.834294 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-beb0688e-f4fc-43f8-95a4-18d875e49a4d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:05.840054 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-beb0688e-f4fc-43f8-95a4-18d875e49a4d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:05.840508 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-beb0688e-f4fc-43f8-95a4-18d875e49a4d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:05.841280 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-beb0688e-f4fc-43f8-95a4-18d875e49a4d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:05.841716 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-beb0688e-f4fc-43f8-95a4-18d875e49a4d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:05.863440 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.objects.instance [None req-beb0688e-f4fc-43f8-95a4-18d875e49a4d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lazy-loading 'flavor' on Instance uuid da7e9d31-7e6e-419c-8dbe-389d6b7bc47d {{(pid=116098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 12 02:46:05.933521 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-beb0688e-f4fc-43f8-95a4-18d875e49a4d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "POST /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d/action" status: 202 len: 0 microversion: 2.1 time: 0.104972 Nov 12 02:46:05.934098 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 728/1486] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:46:05 2021] POST /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:46:05.941123 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: ERROR oslo.messaging._drivers.impl_rabbit [-] [632c0afe-44c8-461b-8c86-3ae649209681] AMQP server on 10.222.0.70:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 12 02:46:05.946039 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-69055d5b-7e3e-405b-813c-88563d03ab66 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:05.946775 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-69055d5b-7e3e-405b-813c-88563d03ab66 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:05.953216 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-69055d5b-7e3e-405b-813c-88563d03ab66 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:05.954250 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-69055d5b-7e3e-405b-813c-88563d03ab66 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:05.955325 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-69055d5b-7e3e-405b-813c-88563d03ab66 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:05.955769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-69055d5b-7e3e-405b-813c-88563d03ab66 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:06.099776 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-69055d5b-7e3e-405b-813c-88563d03ab66 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:06.107132 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-69055d5b-7e3e-405b-813c-88563d03ab66 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1569 microversion: 2.1 time: 0.167956 Nov 12 02:46:06.107692 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 759/1487] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:05 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:07.126895 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-0f59759c-3db7-4645-a7c0-3131542a9e10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:07.127593 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-0f59759c-3db7-4645-a7c0-3131542a9e10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:07.133758 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f59759c-3db7-4645-a7c0-3131542a9e10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:07.134237 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f59759c-3db7-4645-a7c0-3131542a9e10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:07.135022 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f59759c-3db7-4645-a7c0-3131542a9e10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:07.135455 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-0f59759c-3db7-4645-a7c0-3131542a9e10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:07.271583 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-0f59759c-3db7-4645-a7c0-3131542a9e10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:07.278958 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-0f59759c-3db7-4645-a7c0-3131542a9e10 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1569 microversion: 2.1 time: 0.157279 Nov 12 02:46:07.279522 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 729/1488] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:07 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:08.296391 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-4002ed07-3928-4563-b6dd-84480c547338 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:08.297568 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-4002ed07-3928-4563-b6dd-84480c547338 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:08.313772 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4002ed07-3928-4563-b6dd-84480c547338 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:08.314221 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4002ed07-3928-4563-b6dd-84480c547338 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:08.315031 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4002ed07-3928-4563-b6dd-84480c547338 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:08.315469 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-4002ed07-3928-4563-b6dd-84480c547338 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:08.321126 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO oslo.messaging._drivers.impl_rabbit [-] [632c0afe-44c8-461b-8c86-3ae649209681] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 47842. Nov 12 02:46:08.456144 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-4002ed07-3928-4563-b6dd-84480c547338 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:08.463481 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-4002ed07-3928-4563-b6dd-84480c547338 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1569 microversion: 2.1 time: 0.170833 Nov 12 02:46:08.464041 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 760/1489] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:08 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:09.480430 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-023fefd4-cb51-4ad5-8a00-582547b6bd56 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:09.480977 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-023fefd4-cb51-4ad5-8a00-582547b6bd56 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:09.487699 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-023fefd4-cb51-4ad5-8a00-582547b6bd56 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:09.488148 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-023fefd4-cb51-4ad5-8a00-582547b6bd56 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:09.488910 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-023fefd4-cb51-4ad5-8a00-582547b6bd56 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:09.489355 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-023fefd4-cb51-4ad5-8a00-582547b6bd56 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:09.619749 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-023fefd4-cb51-4ad5-8a00-582547b6bd56 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:09.627396 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-023fefd4-cb51-4ad5-8a00-582547b6bd56 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1569 microversion: 2.1 time: 0.150688 Nov 12 02:46:09.627953 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 730/1490] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:09 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:10.645875 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-97b40bb0-8400-48ed-b41f-f12a8335d1b3 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:10.646586 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-97b40bb0-8400-48ed-b41f-f12a8335d1b3 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:10.652871 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-97b40bb0-8400-48ed-b41f-f12a8335d1b3 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:10.653319 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-97b40bb0-8400-48ed-b41f-f12a8335d1b3 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:10.654088 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-97b40bb0-8400-48ed-b41f-f12a8335d1b3 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:10.654522 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-97b40bb0-8400-48ed-b41f-f12a8335d1b3 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:10.790373 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-97b40bb0-8400-48ed-b41f-f12a8335d1b3 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:10.797720 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-97b40bb0-8400-48ed-b41f-f12a8335d1b3 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1569 microversion: 2.1 time: 0.155566 Nov 12 02:46:10.798288 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 761/1491] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:10 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:11.815169 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-3a3302f6-a737-4597-9adf-e82ad851e157 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:11.815784 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-3a3302f6-a737-4597-9adf-e82ad851e157 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:11.822191 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3a3302f6-a737-4597-9adf-e82ad851e157 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:11.822787 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3a3302f6-a737-4597-9adf-e82ad851e157 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:11.823719 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3a3302f6-a737-4597-9adf-e82ad851e157 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:11.824355 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-3a3302f6-a737-4597-9adf-e82ad851e157 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:11.960190 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-3a3302f6-a737-4597-9adf-e82ad851e157 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:11.967466 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-3a3302f6-a737-4597-9adf-e82ad851e157 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1569 microversion: 2.1 time: 0.156617 Nov 12 02:46:11.968031 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 731/1492] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:11 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:12.984052 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-758410e6-c4e7-46b1-b9aa-8abe2ba7964f tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:12.985298 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-758410e6-c4e7-46b1-b9aa-8abe2ba7964f tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:12.991651 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-758410e6-c4e7-46b1-b9aa-8abe2ba7964f tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:12.992100 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-758410e6-c4e7-46b1-b9aa-8abe2ba7964f tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:12.992878 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-758410e6-c4e7-46b1-b9aa-8abe2ba7964f tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:12.993312 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-758410e6-c4e7-46b1-b9aa-8abe2ba7964f tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:13.128599 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-758410e6-c4e7-46b1-b9aa-8abe2ba7964f tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:13.135989 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-758410e6-c4e7-46b1-b9aa-8abe2ba7964f tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1569 microversion: 2.1 time: 0.155690 Nov 12 02:46:13.136545 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 762/1493] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:12 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:13.696154 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:46:13.696433 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: Fri Nov 12 02:46:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:46:14.152953 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-20f34819-c59f-4490-bae6-07249393f7c4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:14.153556 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-20f34819-c59f-4490-bae6-07249393f7c4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:14.159989 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20f34819-c59f-4490-bae6-07249393f7c4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:14.160441 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20f34819-c59f-4490-bae6-07249393f7c4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:14.161215 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20f34819-c59f-4490-bae6-07249393f7c4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:14.161642 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-20f34819-c59f-4490-bae6-07249393f7c4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:14.298282 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-20f34819-c59f-4490-bae6-07249393f7c4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:14.306137 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-20f34819-c59f-4490-bae6-07249393f7c4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1569 microversion: 2.1 time: 0.156854 Nov 12 02:46:14.306731 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 732/1494] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:14 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:14.476219 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:46:14.476451 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: Fri Nov 12 02:46:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:46:15.323769 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-c6effb8e-3e5e-417f-a782-f5fd4d13e792 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:15.324354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-c6effb8e-3e5e-417f-a782-f5fd4d13e792 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:15.331311 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c6effb8e-3e5e-417f-a782-f5fd4d13e792 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:15.331765 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c6effb8e-3e5e-417f-a782-f5fd4d13e792 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:15.332555 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c6effb8e-3e5e-417f-a782-f5fd4d13e792 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:15.333103 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-c6effb8e-3e5e-417f-a782-f5fd4d13e792 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:15.465255 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-c6effb8e-3e5e-417f-a782-f5fd4d13e792 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:15.472543 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-c6effb8e-3e5e-417f-a782-f5fd4d13e792 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1569 microversion: 2.1 time: 0.152643 Nov 12 02:46:15.473103 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 763/1495] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:15 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:16.489684 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-8b1bbcee-fc07-4cbc-9cf2-1b2d4c3f32a4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:16.490293 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-8b1bbcee-fc07-4cbc-9cf2-1b2d4c3f32a4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:16.496906 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b1bbcee-fc07-4cbc-9cf2-1b2d4c3f32a4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:16.497350 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b1bbcee-fc07-4cbc-9cf2-1b2d4c3f32a4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:16.498137 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b1bbcee-fc07-4cbc-9cf2-1b2d4c3f32a4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:16.498570 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-8b1bbcee-fc07-4cbc-9cf2-1b2d4c3f32a4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:16.724636 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-8b1bbcee-fc07-4cbc-9cf2-1b2d4c3f32a4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:16.731917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-8b1bbcee-fc07-4cbc-9cf2-1b2d4c3f32a4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1569 microversion: 2.1 time: 0.245945 Nov 12 02:46:16.732487 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 733/1496] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:16 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:17.748283 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-a8b0d2c9-b4c6-4b0f-9088-dd2d707e0980 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:17.748886 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-a8b0d2c9-b4c6-4b0f-9088-dd2d707e0980 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:17.755783 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a8b0d2c9-b4c6-4b0f-9088-dd2d707e0980 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:17.756239 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a8b0d2c9-b4c6-4b0f-9088-dd2d707e0980 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:17.757008 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a8b0d2c9-b4c6-4b0f-9088-dd2d707e0980 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:17.757445 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-a8b0d2c9-b4c6-4b0f-9088-dd2d707e0980 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:17.888579 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-a8b0d2c9-b4c6-4b0f-9088-dd2d707e0980 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:17.895868 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-a8b0d2c9-b4c6-4b0f-9088-dd2d707e0980 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1569 microversion: 2.1 time: 0.151330 Nov 12 02:46:17.896527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 764/1497] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:17 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:18.912831 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-f2974384-ca87-415e-b941-99e0b1504e44 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:18.913435 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-f2974384-ca87-415e-b941-99e0b1504e44 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:18.919726 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2974384-ca87-415e-b941-99e0b1504e44 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:18.920167 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2974384-ca87-415e-b941-99e0b1504e44 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:18.920964 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2974384-ca87-415e-b941-99e0b1504e44 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:18.921387 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-f2974384-ca87-415e-b941-99e0b1504e44 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:19.058468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-f2974384-ca87-415e-b941-99e0b1504e44 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:19.067657 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-f2974384-ca87-415e-b941-99e0b1504e44 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1569 microversion: 2.1 time: 0.158157 Nov 12 02:46:19.068503 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 734/1498] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:18 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:20.084902 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e828dd51-4c10-4298-8696-d337e68cff52 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:20.085505 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e828dd51-4c10-4298-8696-d337e68cff52 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:20.091942 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e828dd51-4c10-4298-8696-d337e68cff52 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:20.092385 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e828dd51-4c10-4298-8696-d337e68cff52 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:20.093157 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e828dd51-4c10-4298-8696-d337e68cff52 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:20.094172 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e828dd51-4c10-4298-8696-d337e68cff52 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:20.237527 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e828dd51-4c10-4298-8696-d337e68cff52 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:20.245298 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e828dd51-4c10-4298-8696-d337e68cff52 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1510 microversion: 2.1 time: 0.164141 Nov 12 02:46:20.245856 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 765/1499] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:20 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:20.261310 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-4763f9ce-4989-4150-b6d5-be109f667ff5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:46:20.261876 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-4763f9ce-4989-4150-b6d5-be109f667ff5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:20.268743 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4763f9ce-4989-4150-b6d5-be109f667ff5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:20.269245 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4763f9ce-4989-4150-b6d5-be109f667ff5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:20.270139 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4763f9ce-4989-4150-b6d5-be109f667ff5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:20.270573 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-4763f9ce-4989-4150-b6d5-be109f667ff5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:20.343434 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-4763f9ce-4989-4150-b6d5-be109f667ff5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "POST /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d/action" status: 202 len: 0 microversion: 2.1 time: 0.085377 Nov 12 02:46:20.343938 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 735/1500] 10.222.0.70 () {60 vars in 1277 bytes} [Fri Nov 12 02:46:20 2021] POST /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 12 02:46:20.351675 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-42b57d7b-ffe0-4d69-af55-e5f52e7fee1e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:20.352287 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-42b57d7b-ffe0-4d69-af55-e5f52e7fee1e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:20.358199 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42b57d7b-ffe0-4d69-af55-e5f52e7fee1e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:20.358645 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42b57d7b-ffe0-4d69-af55-e5f52e7fee1e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:20.359994 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42b57d7b-ffe0-4d69-af55-e5f52e7fee1e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:20.360423 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-42b57d7b-ffe0-4d69-af55-e5f52e7fee1e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:20.499730 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-42b57d7b-ffe0-4d69-af55-e5f52e7fee1e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:20.507057 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-42b57d7b-ffe0-4d69-af55-e5f52e7fee1e tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1518 microversion: 2.1 time: 0.158966 Nov 12 02:46:20.507629 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 766/1501] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:20 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:20.691136 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:46:20.691280 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: Fri Nov 12 02:46:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:46:21.524240 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-fe384cdb-c6d7-46f4-a651-70e40d2498ae tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:21.524917 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-fe384cdb-c6d7-46f4-a651-70e40d2498ae tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:21.532160 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fe384cdb-c6d7-46f4-a651-70e40d2498ae tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:21.535089 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fe384cdb-c6d7-46f4-a651-70e40d2498ae tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:21.535089 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fe384cdb-c6d7-46f4-a651-70e40d2498ae tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:21.535089 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-fe384cdb-c6d7-46f4-a651-70e40d2498ae tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:21.677568 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-fe384cdb-c6d7-46f4-a651-70e40d2498ae tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:21.685016 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-fe384cdb-c6d7-46f4-a651-70e40d2498ae tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1520 microversion: 2.1 time: 0.164598 Nov 12 02:46:21.685580 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 736/1502] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:21 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:21.979540 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-9867370a-704a-49da-b440-92e198ed664e req-5fc8224e-4b8c-43c5-9998-2b3464578b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7e9d31-7e6e-419c-8dbe-389d6b7bc47d", "name": "network-vif-unplugged", "status": "completed", "tag": "7fb54192-d715-4357-a504-8563617dad4b"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:46:21.981065 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:46:21.981065 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:46:21.988318 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-9867370a-704a-49da-b440-92e198ed664e req-5fc8224e-4b8c-43c5-9998-2b3464578b1d service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:21.988787 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-9867370a-704a-49da-b440-92e198ed664e req-5fc8224e-4b8c-43c5-9998-2b3464578b1d service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:22.001073 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-9867370a-704a-49da-b440-92e198ed664e req-5fc8224e-4b8c-43c5-9998-2b3464578b1d service nova] Creating event network-vif-unplugged:7fb54192-d715-4357-a504-8563617dad4b for instance da7e9d31-7e6e-419c-8dbe-389d6b7bc47d on hv-cinder-80857 Nov 12 02:46:22.006201 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-9867370a-704a-49da-b440-92e198ed664e req-5fc8224e-4b8c-43c5-9998-2b3464578b1d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101268 Nov 12 02:46:22.006831 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 767/1503] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:46:21 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:46:22.703462 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-6f54d5f2-7ec5-4254-b904-7fe3f420d9cf tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:22.704143 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-6f54d5f2-7ec5-4254-b904-7fe3f420d9cf tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:22.710460 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f54d5f2-7ec5-4254-b904-7fe3f420d9cf tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:22.710941 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f54d5f2-7ec5-4254-b904-7fe3f420d9cf tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:22.711722 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f54d5f2-7ec5-4254-b904-7fe3f420d9cf tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:22.712157 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-6f54d5f2-7ec5-4254-b904-7fe3f420d9cf tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:22.911415 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-6f54d5f2-7ec5-4254-b904-7fe3f420d9cf tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:22.918643 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-6f54d5f2-7ec5-4254-b904-7fe3f420d9cf tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1576 microversion: 2.1 time: 0.218991 Nov 12 02:46:22.919225 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 737/1504] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:22 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1576 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:23.935934 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-3d37f34c-8f62-4374-ad7b-30f2c420efea tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:23.936632 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-3d37f34c-8f62-4374-ad7b-30f2c420efea tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:23.942840 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d37f34c-8f62-4374-ad7b-30f2c420efea tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:23.943296 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d37f34c-8f62-4374-ad7b-30f2c420efea tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:23.944253 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d37f34c-8f62-4374-ad7b-30f2c420efea tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:23.944732 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-3d37f34c-8f62-4374-ad7b-30f2c420efea tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:24.135021 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-3d37f34c-8f62-4374-ad7b-30f2c420efea tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:24.142341 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-3d37f34c-8f62-4374-ad7b-30f2c420efea tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1576 microversion: 2.1 time: 0.210950 Nov 12 02:46:24.142943 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 768/1505] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:23 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:25.159314 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a1c394a9-0c40-4a92-97de-18cb33b6344d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:25.159975 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a1c394a9-0c40-4a92-97de-18cb33b6344d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:25.166216 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1c394a9-0c40-4a92-97de-18cb33b6344d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:25.166659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1c394a9-0c40-4a92-97de-18cb33b6344d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:25.167462 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1c394a9-0c40-4a92-97de-18cb33b6344d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:25.167888 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a1c394a9-0c40-4a92-97de-18cb33b6344d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:25.318826 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-a1c394a9-0c40-4a92-97de-18cb33b6344d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:25.332580 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a1c394a9-0c40-4a92-97de-18cb33b6344d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1576 microversion: 2.1 time: 0.176891 Nov 12 02:46:25.333184 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 738/1506] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:25 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:26.350626 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-93ac6b4d-dcdd-427e-aa6c-f83f015466db tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:26.351245 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-93ac6b4d-dcdd-427e-aa6c-f83f015466db tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:26.357493 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-93ac6b4d-dcdd-427e-aa6c-f83f015466db tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:26.357927 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-93ac6b4d-dcdd-427e-aa6c-f83f015466db tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:26.358746 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-93ac6b4d-dcdd-427e-aa6c-f83f015466db tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:26.359261 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-93ac6b4d-dcdd-427e-aa6c-f83f015466db tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:26.491903 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-93ac6b4d-dcdd-427e-aa6c-f83f015466db tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:26.499334 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-93ac6b4d-dcdd-427e-aa6c-f83f015466db tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1576 microversion: 2.1 time: 0.152328 Nov 12 02:46:26.500438 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 769/1507] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:26 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:27.517310 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-27ae2f28-3d68-42ae-b9e0-ccc8ee47fb02 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:27.517928 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-27ae2f28-3d68-42ae-b9e0-ccc8ee47fb02 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:27.524462 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-27ae2f28-3d68-42ae-b9e0-ccc8ee47fb02 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:27.524899 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-27ae2f28-3d68-42ae-b9e0-ccc8ee47fb02 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:27.525714 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-27ae2f28-3d68-42ae-b9e0-ccc8ee47fb02 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:27.526137 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-27ae2f28-3d68-42ae-b9e0-ccc8ee47fb02 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:27.660326 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-27ae2f28-3d68-42ae-b9e0-ccc8ee47fb02 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:27.668196 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-27ae2f28-3d68-42ae-b9e0-ccc8ee47fb02 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1576 microversion: 2.1 time: 0.155219 Nov 12 02:46:27.668765 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 739/1508] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:27 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:28.685063 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-01e543d6-3218-488d-8d61-02735a3e9d57 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:28.685654 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-01e543d6-3218-488d-8d61-02735a3e9d57 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:28.692408 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-01e543d6-3218-488d-8d61-02735a3e9d57 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:28.692824 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-01e543d6-3218-488d-8d61-02735a3e9d57 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:28.693590 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-01e543d6-3218-488d-8d61-02735a3e9d57 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:28.694020 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-01e543d6-3218-488d-8d61-02735a3e9d57 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:28.829142 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-01e543d6-3218-488d-8d61-02735a3e9d57 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:28.843368 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-01e543d6-3218-488d-8d61-02735a3e9d57 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1576 microversion: 2.1 time: 0.161890 Nov 12 02:46:28.843938 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 770/1509] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:28 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:29.862588 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-01b24a76-170d-4060-8d36-5474be5d7641 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:29.863302 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-01b24a76-170d-4060-8d36-5474be5d7641 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:29.869627 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-01b24a76-170d-4060-8d36-5474be5d7641 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:29.870067 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-01b24a76-170d-4060-8d36-5474be5d7641 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:29.870856 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-01b24a76-170d-4060-8d36-5474be5d7641 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:29.871283 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-01b24a76-170d-4060-8d36-5474be5d7641 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:30.007929 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-01b24a76-170d-4060-8d36-5474be5d7641 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:30.015810 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-01b24a76-170d-4060-8d36-5474be5d7641 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1576 microversion: 2.1 time: 0.157278 Nov 12 02:46:30.016393 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 740/1510] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:29 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:46:31.033303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-241215d9-a6fe-42c1-958d-2695b47622d5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:31.033912 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-241215d9-a6fe-42c1-958d-2695b47622d5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:31.040338 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-241215d9-a6fe-42c1-958d-2695b47622d5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:31.040782 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-241215d9-a6fe-42c1-958d-2695b47622d5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:31.041598 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-241215d9-a6fe-42c1-958d-2695b47622d5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:31.042032 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-241215d9-a6fe-42c1-958d-2695b47622d5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:31.173238 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-241215d9-a6fe-42c1-958d-2695b47622d5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:31.180707 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-241215d9-a6fe-42c1-958d-2695b47622d5 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1576 microversion: 2.1 time: 0.151611 Nov 12 02:46:31.181270 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 771/1511] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:31 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:32.000323 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-c7b8c3be-f248-4878-86af-6fd90e60dba5 req-2420f734-894d-43c9-8f47-806b648d8465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7e9d31-7e6e-419c-8dbe-389d6b7bc47d", "name": "network-vif-plugged", "status": "completed", "tag": "7fb54192-d715-4357-a504-8563617dad4b"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:46:32.001978 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:46:32.001978 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:46:32.010641 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-c7b8c3be-f248-4878-86af-6fd90e60dba5 req-2420f734-894d-43c9-8f47-806b648d8465 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:32.011161 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-c7b8c3be-f248-4878-86af-6fd90e60dba5 req-2420f734-894d-43c9-8f47-806b648d8465 service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:32.022962 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-c7b8c3be-f248-4878-86af-6fd90e60dba5 req-2420f734-894d-43c9-8f47-806b648d8465 service nova] Creating event network-vif-plugged:7fb54192-d715-4357-a504-8563617dad4b for instance da7e9d31-7e6e-419c-8dbe-389d6b7bc47d on hv-cinder-80857 Nov 12 02:46:32.027986 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-c7b8c3be-f248-4878-86af-6fd90e60dba5 req-2420f734-894d-43c9-8f47-806b648d8465 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031452 Nov 12 02:46:32.028789 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 741/1512] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:46:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:46:32.199855 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-88f2d56d-3f0c-43e8-a61e-885e444d5262 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:32.200472 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-88f2d56d-3f0c-43e8-a61e-885e444d5262 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:32.206817 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-88f2d56d-3f0c-43e8-a61e-885e444d5262 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:32.207276 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-88f2d56d-3f0c-43e8-a61e-885e444d5262 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:32.208063 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-88f2d56d-3f0c-43e8-a61e-885e444d5262 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:32.208499 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-88f2d56d-3f0c-43e8-a61e-885e444d5262 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:32.413146 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-88f2d56d-3f0c-43e8-a61e-885e444d5262 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:32.420298 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-88f2d56d-3f0c-43e8-a61e-885e444d5262 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1576 microversion: 2.1 time: 0.224806 Nov 12 02:46:32.420868 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 772/1513] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:32 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1576 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:46:33.437933 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-c1529779-bf68-408d-a690-dcc000d30a91 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:33.438546 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-c1529779-bf68-408d-a690-dcc000d30a91 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:33.445022 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c1529779-bf68-408d-a690-dcc000d30a91 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:33.445468 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c1529779-bf68-408d-a690-dcc000d30a91 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:33.446242 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c1529779-bf68-408d-a690-dcc000d30a91 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:33.446696 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-c1529779-bf68-408d-a690-dcc000d30a91 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:33.579982 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-c1529779-bf68-408d-a690-dcc000d30a91 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:33.587341 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-c1529779-bf68-408d-a690-dcc000d30a91 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1576 microversion: 2.1 time: 0.153499 Nov 12 02:46:33.587903 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 742/1514] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:33 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:46:34.605365 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-e8d3d8f2-c10d-435b-bbf5-b6457a2d9058 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:46:34.605951 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-e8d3d8f2-c10d-435b-bbf5-b6457a2d9058 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:46:34.612379 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8d3d8f2-c10d-435b-bbf5-b6457a2d9058 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:34.612831 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8d3d8f2-c10d-435b-bbf5-b6457a2d9058 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:34.613633 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8d3d8f2-c10d-435b-bbf5-b6457a2d9058 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:46:34.614073 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-e8d3d8f2-c10d-435b-bbf5-b6457a2d9058 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:46:34.756804 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-e8d3d8f2-c10d-435b-bbf5-b6457a2d9058 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:46:34.764279 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-e8d3d8f2-c10d-435b-bbf5-b6457a2d9058 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1563 microversion: 2.1 time: 0.162703 Nov 12 02:46:34.764904 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 773/1515] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:46:34 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:48:01.095712 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:48:01.096368 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: Fri Nov 12 02:48:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:48:10.827025 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [req-af3e010f-817f-47bd-925d-d654f2c4dfe9 req-4e72d255-baf1-4789-86d1-5d296a82b23b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da7e9d31-7e6e-419c-8dbe-389d6b7bc47d", "tag": "7fb54192-d715-4357-a504-8563617dad4b"}]} {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:48:10.828530 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:48:10.828530 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: warnings.warn(msg) Nov 12 02:48:10.833884 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a642aa3c-b154-49bb-9a48-8a4c841d6895 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:48:10.835075 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a642aa3c-b154-49bb-9a48-8a4c841d6895 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:48:10.837580 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-af3e010f-817f-47bd-925d-d654f2c4dfe9 req-4e72d255-baf1-4789-86d1-5d296a82b23b service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:48:10.838419 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [req-af3e010f-817f-47bd-925d-d654f2c4dfe9 req-4e72d255-baf1-4789-86d1-5d296a82b23b service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:48:10.842659 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a642aa3c-b154-49bb-9a48-8a4c841d6895 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:48:10.843124 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a642aa3c-b154-49bb-9a48-8a4c841d6895 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:48:10.844111 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a642aa3c-b154-49bb-9a48-8a4c841d6895 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:48:10.844570 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-a642aa3c-b154-49bb-9a48-8a4c841d6895 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:48:10.852711 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.compute.server_external_events [req-af3e010f-817f-47bd-925d-d654f2c4dfe9 req-4e72d255-baf1-4789-86d1-5d296a82b23b service nova] Creating event network-changed:7fb54192-d715-4357-a504-8563617dad4b for instance da7e9d31-7e6e-419c-8dbe-389d6b7bc47d on hv-cinder-80857 Nov 12 02:48:10.858396 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [req-af3e010f-817f-47bd-925d-d654f2c4dfe9 req-4e72d255-baf1-4789-86d1-5d296a82b23b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035815 Nov 12 02:48:10.859351 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 774/1516] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:48:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:48:10.872979 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-a642aa3c-b154-49bb-9a48-8a4c841d6895 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Going to try to terminate instance {{(pid=116098) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 12 02:48:10.963934 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a642aa3c-b154-49bb-9a48-8a4c841d6895 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "DELETE /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 204 len: 0 microversion: 2.1 time: 0.145163 Nov 12 02:48:10.964581 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 743/1517] 10.222.0.70 () {58 vars in 1238 bytes} [Fri Nov 12 02:48:10 2021] DELETE /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 12 02:48:10.974890 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-cd437efd-3da8-4d7b-84a1-45e262bb25ca tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:48:10.975801 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-cd437efd-3da8-4d7b-84a1-45e262bb25ca tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:48:10.986962 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cd437efd-3da8-4d7b-84a1-45e262bb25ca tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:48:10.988126 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cd437efd-3da8-4d7b-84a1-45e262bb25ca tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:48:10.989894 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cd437efd-3da8-4d7b-84a1-45e262bb25ca tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:48:10.991704 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-cd437efd-3da8-4d7b-84a1-45e262bb25ca tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:48:11.234500 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-cd437efd-3da8-4d7b-84a1-45e262bb25ca tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:48:11.244670 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-cd437efd-3da8-4d7b-84a1-45e262bb25ca tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1569 microversion: 2.1 time: 0.274867 Nov 12 02:48:11.245407 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 775/1518] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:48:10 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1569 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:48:12.264504 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-14d2d86a-94fa-49d3-a482-f725987fd59d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:48:12.265153 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.compute.api [None req-14d2d86a-94fa-49d3-a482-f725987fd59d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116098) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:48:12.271728 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14d2d86a-94fa-49d3-a482-f725987fd59d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:48:12.272174 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14d2d86a-94fa-49d3-a482-f725987fd59d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:48:12.273514 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14d2d86a-94fa-49d3-a482-f725987fd59d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:48:12.273942 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [None req-14d2d86a-94fa-49d3-a482-f725987fd59d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:48:12.422728 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.policy [None req-14d2d86a-94fa-49d3-a482-f725987fd59d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116098) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:48:12.430750 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-14d2d86a-94fa-49d3-a482-f725987fd59d tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1450 microversion: 2.1 time: 0.170563 Nov 12 02:48:12.431326 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 744/1519] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:48:12 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1450 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 12 02:48:13.447529 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-5b243f0c-a128-41c3-88ca-262cbdd58bc7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:48:13.448801 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-5b243f0c-a128-41c3-88ca-262cbdd58bc7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:48:13.455642 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5b243f0c-a128-41c3-88ca-262cbdd58bc7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:48:13.456091 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5b243f0c-a128-41c3-88ca-262cbdd58bc7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:48:13.456875 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5b243f0c-a128-41c3-88ca-262cbdd58bc7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:48:13.457303 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-5b243f0c-a128-41c3-88ca-262cbdd58bc7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:48:13.573136 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.policy [None req-5b243f0c-a128-41c3-88ca-262cbdd58bc7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c56e75d27c448fc9be9ccc0d0f5efd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6994b5f4e24d6483ad3e16b25cf629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116099) authorize /opt/stack/nova/nova/policy.py:199}} Nov 12 02:48:13.580921 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-5b243f0c-a128-41c3-88ca-262cbdd58bc7 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 200 len: 1382 microversion: 2.1 time: 0.137282 Nov 12 02:48:13.581513 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 776/1520] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:48:13 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 1382 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 12 02:48:13.721043 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [req-b9c1779d-0526-4760-aedc-7d35ad38e46a req-3002a338-730b-4605-92a2-02e72dbed6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7e9d31-7e6e-419c-8dbe-389d6b7bc47d", "name": "network-vif-deleted", "tag": "7fb54192-d715-4357-a504-8563617dad4b"}]} {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 12 02:48:13.723641 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 12 02:48:13.723641 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: warnings.warn(msg) Nov 12 02:48:13.733584 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-b9c1779d-0526-4760-aedc-7d35ad38e46a req-3002a338-730b-4605-92a2-02e72dbed6fc service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:48:13.734025 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG oslo_concurrency.lockutils [req-b9c1779d-0526-4760-aedc-7d35ad38e46a req-3002a338-730b-4605-92a2-02e72dbed6fc service nova] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:48:13.746154 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.compute.server_external_events [req-b9c1779d-0526-4760-aedc-7d35ad38e46a req-3002a338-730b-4605-92a2-02e72dbed6fc service nova] Creating event network-vif-deleted:7fb54192-d715-4357-a504-8563617dad4b for instance da7e9d31-7e6e-419c-8dbe-389d6b7bc47d on hv-cinder-80857 Nov 12 02:48:13.752578 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [req-b9c1779d-0526-4760-aedc-7d35ad38e46a req-3002a338-730b-4605-92a2-02e72dbed6fc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114268 Nov 12 02:48:13.753185 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 745/1521] 10.222.0.70 () {64 vars in 1317 bytes} [Fri Nov 12 02:48:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 12 02:48:14.598609 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-101fbd2f-fb04-4e66-ace5-743129748b37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '>' {{(pid=116099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:48:14.599328 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.compute.api [None req-101fbd2f-fb04-4e66-ace5-743129748b37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] [instance: da7e9d31-7e6e-419c-8dbe-389d6b7bc47d] Fetching instance by UUID {{(pid=116099) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 12 02:48:14.607908 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-101fbd2f-fb04-4e66-ace5-743129748b37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:48:14.608354 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-101fbd2f-fb04-4e66-ace5-743129748b37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:48:14.609142 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-101fbd2f-fb04-4e66-ace5-743129748b37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 12 02:48:14.609574 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG oslo_concurrency.lockutils [None req-101fbd2f-fb04-4e66-ace5-743129748b37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Lock "2c0359a2-e5a9-489f-af7a-d55f1eaf3ef6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 12 02:48:14.624604 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.wsgi [None req-101fbd2f-fb04-4e66-ace5-743129748b37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] HTTP exception thrown: Instance da7e9d31-7e6e-419c-8dbe-389d6b7bc47d could not be found. Nov 12 02:48:14.625208 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: DEBUG nova.api.openstack.wsgi [None req-101fbd2f-fb04-4e66-ace5-743129748b37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Returning 404 to user: Instance da7e9d31-7e6e-419c-8dbe-389d6b7bc47d could not be found. {{(pid=116099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 12 02:48:14.626259 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO nova.api.openstack.requestlog [None req-101fbd2f-fb04-4e66-ace5-743129748b37 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d" status: 404 len: 111 microversion: 2.1 time: 0.032534 Nov 12 02:48:14.626874 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: [pid: 116099|app: 0|req: 777/1522] 10.222.0.70 () {58 vars in 1235 bytes} [Fri Nov 12 02:48:14 2021] GET /compute/v2.1/servers/da7e9d31-7e6e-419c-8dbe-389d6b7bc47d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 12 02:48:14.815836 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: DEBUG nova.api.openstack.wsgi [None req-a0fcac91-ab57-4458-b111-4eb8f7a481f4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] Calling method '.version_select at 0x7fc064581b80>' {{(pid=116098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 12 02:48:14.843105 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO nova.api.openstack.requestlog [None req-a0fcac91-ab57-4458-b111-4eb8f7a481f4 tempest-TestShelveInstance-261925512 tempest-TestShelveInstance-261925512-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-501889527" status: 202 len: 0 microversion: 2.1 time: 0.031713 Nov 12 02:48:14.844023 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: [pid: 116098|app: 0|req: 746/1523] 10.222.0.70 () {58 vars in 1250 bytes} [Fri Nov 12 02:48:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-501889527 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 12 02:49:33.714498 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:49:33.715181 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: Fri Nov 12 02:49:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:49:34.494504 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:49:34.495106 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: Fri Nov 12 02:49:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:49:40.709838 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:49:40.711060 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: Fri Nov 12 02:49:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:51:21.113433 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:51:21.114049 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: Fri Nov 12 02:51:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:52:53.732260 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:52:53.732881 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: Fri Nov 12 02:52:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:52:54.512593 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:52:54.513039 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: Fri Nov 12 02:52:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:53:00.727766 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:53:00.728302 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: Fri Nov 12 02:53:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:53:23.233830 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:53:23.234436 dv-cinder-808574-4-iscsi devstack@n-api.service[116098]: Fri Nov 12 02:53:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 12 02:53:23.907789 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 12 02:53:23.908361 dv-cinder-808574-4-iscsi devstack@n-api.service[116099]: Fri Nov 12 02:53:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!